2026-03-30 12:05:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 12:05:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 12:05:03 [auto1.it] INFO: Batch mode enabled: batch 2/2
2026-03-30 12:05:03 [auto1.it] INFO: Starting spider auto1.it
2026-03-30 12:05:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 12:05:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 12:05:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 12:05:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 12:05:03 [scrapy.extensions.telnet] INFO: Telnet Password: 737e1ca886c9aa0e
2026-03-30 12:05:03 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 12:05:03 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_23_2026-03-30T12_05_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 12:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:05:03 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 12:05:03 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 12:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 12:05:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 12:05:03 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 12:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 12:05:03 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 12:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:05:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 12:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 12:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 12:05:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 12:05:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 12:05:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 12:05:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 12:05:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:05:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 12:05:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 12:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:05:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 12:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:06:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:07:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 12:07:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.144(s), this was the 1st time calling it.
2026-03-30 12:07:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.974103682805206 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 12:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 12:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 12:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:08:04 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 151MiB
2026-03-30 12:09:04 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 12:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 151MiB
2026-03-30 12:09:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.941(s), this was the 1st time calling it.
2026-03-30 12:09:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.34764886869521 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 12:09:58 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3568 | hits on page: 40
2026-03-30 12:09:58 [auto1.it] INFO: Found listing with ID: PW81398
2026-03-30 12:09:58 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN64307%27 HTTP/1.1" 200 None
2026-03-30 12:09:58 [auto1.it] INFO: Scrape type for JN64307: 2
2026-03-30 12:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a937387-706c-5d97-a9be-474da18b97ef with identifier: JN64307
2026-03-30 12:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a937387-706c-5d97-a9be-474da18b97ef with scrape type 2
2026-03-30 12:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a937387-706c-5d97-a9be-474da18b97ef with scrape type 2
2026-03-30 12:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a937387-706c-5d97-a9be-474da18b97ef, identifier: JN64307
2026-03-30 12:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a937387-706c-5d97-a9be-474da18b97ef with identifier: JN64307
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 12:09:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 12:09:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a937387-706c-5d97-a9be-474da18b97ef with identifier: JN64307
2026-03-30 12:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a937387-706c-5d97-a9be-474da18b97ef with identifier: JN64307 to the API
2026-03-30 12:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:07:36Z',
'fuel_type': 'diesel',
'id': '9a937387-706c-5d97-a9be-474da18b97ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN64307',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 190127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-25',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2013}
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN64307%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Saving data for JN64307: {'auction_closing_time': 1774969656.0, 'created_time': 1772627091.674034, 'last_price_update_time': 1774872600.672436}
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN64307') HTTP/1.1" 204 0
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: JE46327
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: BX32747
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX32747%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for BX32747: 1
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: ZY39181
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: VN14179
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: CA07652
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: YF54958
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: BJ31880
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ31880%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for BJ31880: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: EC16043
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: PL88180
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: LA31709
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA31709%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for LA31709: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: BU00285
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU00285%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for BU00285: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: BL12748
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL12748%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for BL12748: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: DR86004
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR86004%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for DR86004: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: HZ90603
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: TU32641
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: LF79348
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF79348%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for LF79348: 1
2026-03-30 12:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: AS60977
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: YP27472
2026-03-30 12:10:00 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB77184%27 HTTP/1.1" 200 None
2026-03-30 12:10:00 [auto1.it] INFO: Scrape type for GB77184: 2
2026-03-30 12:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with identifier: GB77184
2026-03-30 12:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with scrape type 2
2026-03-30 12:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with scrape type 2
2026-03-30 12:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e4e9b6f-ed01-536c-b355-7bacdeea57c0, identifier: GB77184
2026-03-30 12:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with identifier: GB77184
2026-03-30 12:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with identifier: GB77184
2026-03-30 12:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e4e9b6f-ed01-536c-b355-7bacdeea57c0 with identifier: GB77184 to the API
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:16:43Z',
'fuel_type': 'diesel',
'id': '2e4e9b6f-ed01-536c-b355-7bacdeea57c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB77184',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 213863,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-28',
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB77184%27 HTTP/1.1" 200 None
2026-03-30 12:10:01 [auto1.it] INFO: Saving data for GB77184: {'auction_closing_time': 1774970203.0, 'created_time': 1772625928.284695, 'last_price_update_time': 1774872601.515507}
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GB77184') HTTP/1.1" 204 0
2026-03-30 12:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:01 [auto1.it] INFO: Found listing with ID: ZK14239
2026-03-30 12:10:01 [auto1.it] INFO: Found listing with ID: LD85970
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD85970%27 HTTP/1.1" 200 None
2026-03-30 12:10:01 [auto1.it] INFO: Scrape type for LD85970: 2
2026-03-30 12:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with identifier: LD85970
2026-03-30 12:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with scrape type 2
2026-03-30 12:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with scrape type 2
2026-03-30 12:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e32f51a1-cff6-563b-9504-c8e0d2ed2a06, identifier: LD85970
2026-03-30 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with identifier: LD85970
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 12:10:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with identifier: LD85970
2026-03-30 12:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e32f51a1-cff6-563b-9504-c8e0d2ed2a06 with identifier: LD85970 to the API
2026-03-30 12:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:29:08Z',
'fuel_type': 'petrol',
'id': 'e32f51a1-cff6-563b-9504-c8e0d2ed2a06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD85970',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 58177,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-21',
'seller_name': None,
'title': 'MINI Countryman Cooper Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2022}
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD85970%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Saving data for LD85970: {'auction_closing_time': 1774970948.0, 'created_time': 1772621452.121767, 'last_price_update_time': 1774872602.174632}
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD85970') HTTP/1.1" 204 0
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: WC33505
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC33505%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Scrape type for WC33505: 1
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05628%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Scrape type for SC05628: 2
2026-03-30 12:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238af2f8-71db-561b-9d94-a0ed5db0a320 with identifier: SC05628
2026-03-30 12:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238af2f8-71db-561b-9d94-a0ed5db0a320 with scrape type 2
2026-03-30 12:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 238af2f8-71db-561b-9d94-a0ed5db0a320 with scrape type 2
2026-03-30 12:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 238af2f8-71db-561b-9d94-a0ed5db0a320, identifier: SC05628
2026-03-30 12:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 238af2f8-71db-561b-9d94-a0ed5db0a320 with identifier: SC05628
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 12:10:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 238af2f8-71db-561b-9d94-a0ed5db0a320 with identifier: SC05628
2026-03-30 12:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 238af2f8-71db-561b-9d94-a0ed5db0a320 with identifier: SC05628 to the API
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:23:21Z',
'fuel_type': 'diesel',
'id': '238af2f8-71db-561b-9d94-a0ed5db0a320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC05628',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 134924,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-13',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2016}
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05628%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Saving data for SC05628: {'auction_closing_time': 1774970601.0, 'created_time': 1772781786.821036, 'last_price_update_time': 1774872602.805434}
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC05628') HTTP/1.1" 204 0
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: VT28696
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: MU07999
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU07999%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Scrape type for MU07999: 1
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: WM56672
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: SZ97857
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ97857%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Scrape type for SZ97857: 1
2026-03-30 12:10:02 [auto1.it] INFO: Found listing with ID: SA54199
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA54199%27 HTTP/1.1" 200 None
2026-03-30 12:10:02 [auto1.it] INFO: Scrape type for SA54199: 2
2026-03-30 12:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with identifier: SA54199
2026-03-30 12:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with scrape type 2
2026-03-30 12:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with scrape type 2
2026-03-30 12:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52adafa1-43ee-5b78-9c95-8bdb9acdab91, identifier: SA54199
2026-03-30 12:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with identifier: SA54199
2026-03-30 12:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with identifier: SA54199
2026-03-30 12:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52adafa1-43ee-5b78-9c95-8bdb9acdab91 with identifier: SA54199 to the API
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:44:12Z',
'fuel_type': 'diesel',
'id': '52adafa1-43ee-5b78-9c95-8bdb9acdab91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA54199',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 77588,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-29',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2018}
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA54199%27 HTTP/1.1" 200 None
2026-03-30 12:10:03 [auto1.it] INFO: Saving data for SA54199: {'auction_closing_time': 1774971852.0, 'created_time': 1774267652.563878, 'last_price_update_time': 1774872603.474955}
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SA54199') HTTP/1.1" 204 0
2026-03-30 12:10:03 [auto1.it] INFO: Found listing with ID: YV27723
2026-03-30 12:10:03 [auto1.it] INFO: Found listing with ID: LV97351
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV97351%27 HTTP/1.1" 200 None
2026-03-30 12:10:03 [auto1.it] INFO: Scrape type for LV97351: 2
2026-03-30 12:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8dea27b-7a09-5362-b202-f558e3252bcb with identifier: LV97351
2026-03-30 12:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8dea27b-7a09-5362-b202-f558e3252bcb with scrape type 2
2026-03-30 12:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8dea27b-7a09-5362-b202-f558e3252bcb with scrape type 2
2026-03-30 12:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8dea27b-7a09-5362-b202-f558e3252bcb, identifier: LV97351
2026-03-30 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8dea27b-7a09-5362-b202-f558e3252bcb with identifier: LV97351
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 12:10:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8dea27b-7a09-5362-b202-f558e3252bcb with identifier: LV97351
2026-03-30 12:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8dea27b-7a09-5362-b202-f558e3252bcb with identifier: LV97351 to the API
2026-03-30 12:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:16:38Z',
'fuel_type': 'petrol',
'id': 'b8dea27b-7a09-5362-b202-f558e3252bcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV97351',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 29706,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-30',
'seller_name': None,
'title': 'Fiat Tipo 1.5 Mild-Hybrid Cross',
'transmission': 'automatic',
'trim': 'Cross',
'year': 2023}
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV97351%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [auto1.it] INFO: Saving data for LV97351: {'auction_closing_time': 1774970198.0, 'created_time': 1773241843.285527, 'last_price_update_time': 1774872604.190938}
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV97351') HTTP/1.1" 204 0
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: DV12691
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV12691%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [auto1.it] INFO: Scrape type for DV12691: 2
2026-03-30 12:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a456a1cc-06db-5a2e-84cc-6462f521bbdf with identifier: DV12691
2026-03-30 12:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a456a1cc-06db-5a2e-84cc-6462f521bbdf with scrape type 2
2026-03-30 12:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a456a1cc-06db-5a2e-84cc-6462f521bbdf with scrape type 2
2026-03-30 12:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a456a1cc-06db-5a2e-84cc-6462f521bbdf, identifier: DV12691
2026-03-30 12:10:04 [scrapy.extensions.logstats] INFO: Crawled 4 pages (at 1 pages/min), scraped 6 items (at 6 items/min)
2026-03-30 12:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 153MiB
2026-03-30 12:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a456a1cc-06db-5a2e-84cc-6462f521bbdf with identifier: DV12691
2026-03-30 12:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a456a1cc-06db-5a2e-84cc-6462f521bbdf with identifier: DV12691
2026-03-30 12:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a456a1cc-06db-5a2e-84cc-6462f521bbdf with identifier: DV12691 to the API
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:36:45Z',
'fuel_type': 'petrol',
'id': 'a456a1cc-06db-5a2e-84cc-6462f521bbdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV12691',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 227322,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-13',
'seller_name': None,
'title': 'Opel Astra 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV12691%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [auto1.it] INFO: Saving data for DV12691: {'auction_closing_time': 1774971405.0, 'created_time': 1773131515.445414, 'last_price_update_time': 1774872604.844643}
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV12691') HTTP/1.1" 204 0
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: XY45587
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: ED01256
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: FS35820
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS35820%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [auto1.it] INFO: Scrape type for FS35820: 1
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: LR19944
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR19944%27 HTTP/1.1" 200 None
2026-03-30 12:10:04 [auto1.it] INFO: Scrape type for LR19944: 1
2026-03-30 12:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA31709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:04 [auto1.it] INFO: Found listing with ID: RH06885
2026-03-30 12:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC33505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX32747/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ97857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU07999/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS35820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF79348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:04 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 7 pages/min), scraped 7 items (at 1 items/min)
2026-03-30 12:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-30 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ31880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU00285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA31709> (referer: https://www.auto1.com/v1/car-details-view/LA31709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b9fd0c4-ea96-59d5-9dee-13d77b058f96 with identifier: LA31709
2026-03-30 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b9fd0c4-ea96-59d5-9dee-13d77b058f96 with scrape type 1
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b9fd0c4-ea96-59d5-9dee-13d77b058f96
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_f6cb19ec013260d3f980307d93fbc801.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_f6cb19ec013260d3f980307d93fbc801.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_341bde74d3f84ae2409d4aa13674a47f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_341bde74d3f84ae2409d4aa13674a47f.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_9b542c6da08214701343744a8fbccf47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_9b542c6da08214701343744a8fbccf47.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_33ae73226b2e24e829ca96018dc784c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_33ae73226b2e24e829ca96018dc784c0.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_681cab24b3c3a2424caf9879c1543e8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_681cab24b3c3a2424caf9879c1543e8a.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_952da9abab278fb1022070111d87e10d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_952da9abab278fb1022070111d87e10d.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_ac4b3acb60e5ba6c35f9faeba90c8d56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_ac4b3acb60e5ba6c35f9faeba90c8d56.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_bd77c1167abb31d482a8eb8d5a49542d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_bd77c1167abb31d482a8eb8d5a49542d.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_e8151fc9624026603e6149c4bbd7322a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e8151fc9624026603e6149c4bbd7322a.jpg already downloaded
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F32%252F7332f837f0bd0eb345b44c9590ee56d1%252Fpa%252FLA31709_e153880e6a5d316965eee01653cc03b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e153880e6a5d316965eee01653cc03b2.jpg already downloaded
2026-03-30 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b9fd0c4-ea96-59d5-9dee-13d77b058f96, identifier: LA31709
2026-03-30 12:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b9fd0c4-ea96-59d5-9dee-13d77b058f96 with identifier: LA31709
2026-03-30 12:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b9fd0c4-ea96-59d5-9dee-13d77b058f96 with identifier: LA31709
2026-03-30 12:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b9fd0c4-ea96-59d5-9dee-13d77b058f96 with identifier: LA31709 to the API
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LA31709>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:40:21Z',
'fuel_type': 'petrol',
'id': '0b9fd0c4-ea96-59d5-9dee-13d77b058f96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA31709',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 100381,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_f6cb19ec013260d3f980307d93fbc801.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_341bde74d3f84ae2409d4aa13674a47f.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_9b542c6da08214701343744a8fbccf47.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_33ae73226b2e24e829ca96018dc784c0.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_681cab24b3c3a2424caf9879c1543e8a.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_952da9abab278fb1022070111d87e10d.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_ac4b3acb60e5ba6c35f9faeba90c8d56.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_bd77c1167abb31d482a8eb8d5a49542d.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e8151fc9624026603e6149c4bbd7322a.jpg',
'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e153880e6a5d316965eee01653cc03b2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_f6cb19ec013260d3f980307d93fbc801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_341bde74d3f84ae2409d4aa13674a47f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_9b542c6da08214701343744a8fbccf47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_33ae73226b2e24e829ca96018dc784c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_681cab24b3c3a2424caf9879c1543e8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_952da9abab278fb1022070111d87e10d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_ac4b3acb60e5ba6c35f9faeba90c8d56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_bd77c1167abb31d482a8eb8d5a49542d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e8151fc9624026603e6149c4bbd7322a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b9fd0c4-ea96-59d5-9dee-13d77b058f96/0b9fd0c4-ea96-59d5-9dee-13d77b058f96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/32/7332f837f0bd0eb345b44c9590ee56d1/pa/LA31709_e153880e6a5d316965eee01653cc03b2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.1 Ti-VCT Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2022}
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA31709%27 HTTP/1.1" 200 None
2026-03-30 12:11:23 [auto1.it] INFO: Saving data for LA31709: {'created_time': 1774872683.99945, 'last_price_update_time': 1774872683.999461, 'auction_closing_time': 1774971621.0}
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA31709') HTTP/1.1" 204 0
2026-03-30 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ97857> (referer: https://www.auto1.com/v1/car-details-view/SZ97857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737934a1-e195-53ec-92f8-c37481328e84 with identifier: SZ97857
2026-03-30 12:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737934a1-e195-53ec-92f8-c37481328e84 with scrape type 1
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_026cef47c5a75ab2389890d991c80280.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_026cef47c5a75ab2389890d991c80280.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_1831cb0b59bdff90085005f74440502b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_1831cb0b59bdff90085005f74440502b.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_c74b2dafb382d82b45707ef566642aed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_c74b2dafb382d82b45707ef566642aed.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_900da4bea3d0792f3d39204a765861dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_900da4bea3d0792f3d39204a765861dc.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_a646ae0658f0104fb6a40afda01bd636.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_a646ae0658f0104fb6a40afda01bd636.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg not downloaded yet
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_8e2da63003706c7ac9982785f478ff83.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_8e2da63003706c7ac9982785f478ff83.jpg not downloaded yet
2026-03-30 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_1831cb0b59bdff90085005f74440502b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_026cef47c5a75ab2389890d991c80280.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_8e2da63003706c7ac9982785f478ff83.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f1df50>
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_1831cb0b59bdff90085005f74440502b.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_1831cb0b59bdff90085005f74440502b.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_900da4bea3d0792f3d39204a765861dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_c74b2dafb382d82b45707ef566642aed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_a646ae0658f0104fb6a40afda01bd636.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2d690>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_026cef47c5a75ab2389890d991c80280.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_026cef47c5a75ab2389890d991c80280.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f9b510>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_8e2da63003706c7ac9982785f478ff83.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_8e2da63003706c7ac9982785f478ff83.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fac750>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc53d0>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_900da4bea3d0792f3d39204a765861dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_900da4bea3d0792f3d39204a765861dc.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1f890>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a621d0>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_c74b2dafb382d82b45707ef566642aed.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_c74b2dafb382d82b45707ef566642aed.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e32190>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3ce10>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_a646ae0658f0104fb6a40afda01bd636.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_a646ae0658f0104fb6a40afda01bd636.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd8090>
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F48%252F5e48c8cff1fa970b3d566323ffbb6f1a%252Fpa%252FSZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg saved to cache
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 737934a1-e195-53ec-92f8-c37481328e84
2026-03-30 12:11:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 737934a1-e195-53ec-92f8-c37481328e84, skipping ID generation
2026-03-30 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737934a1-e195-53ec-92f8-c37481328e84 with scrape type 1
2026-03-30 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 737934a1-e195-53ec-92f8-c37481328e84 sending to next pipeline
2026-03-30 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 737934a1-e195-53ec-92f8-c37481328e84, identifier: SZ97857
2026-03-30 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 737934a1-e195-53ec-92f8-c37481328e84 with identifier: SZ97857
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 737934a1-e195-53ec-92f8-c37481328e84 with identifier: SZ97857
2026-03-30 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 737934a1-e195-53ec-92f8-c37481328e84 with identifier: SZ97857 to the API
2026-03-30 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': 'Taxi',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-03-31T15:34:27Z',
'fuel_type': 'hybrid',
'id': '737934a1-e195-53ec-92f8-c37481328e84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ97857',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Kia',
'model': 'Niro',
'odometer': 286812,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_026cef47c5a75ab2389890d991c80280.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_1831cb0b59bdff90085005f74440502b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_c74b2dafb382d82b45707ef566642aed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_900da4bea3d0792f3d39204a765861dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_f301b968e14a2755501c5f8cbf6105b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_5471a9001ad06a46a668dd6dd02bb9c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_a646ae0658f0104fb6a40afda01bd636.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_e6a87dbf805e8b7f83ff23a223837bfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_7628688e9a770b64b1ee7b2d5928eb46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_737934a1-e195-53ec-92f8-c37481328e84/737934a1-e195-53ec-92f8-c37481328e84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/48/5e48c8cff1fa970b3d566323ffbb6f1a/pa/SZ97857_8e2da63003706c7ac9982785f478ff83.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Niro 1.6 Hybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-03-30 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ97857%27 HTTP/1.1" 200 None
2026-03-30 12:11:26 [auto1.it] INFO: Saving data for SZ97857: {'created_time': 1774872686.153978, 'last_price_update_time': 1774872686.153989, 'auction_closing_time': 1774971267.0}
2026-03-30 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SZ97857') HTTP/1.1" 204 0
2026-03-30 12:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS35820> (referer: https://www.auto1.com/v1/car-details-view/FS35820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78beb3fa-0728-50c4-8cab-b98e7aa3c991 with identifier: FS35820
2026-03-30 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78beb3fa-0728-50c4-8cab-b98e7aa3c991 with scrape type 1
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78beb3fa-0728-50c4-8cab-b98e7aa3c991
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_c2e58c84c51ad75ad02bf7f6ae66c1b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_c2e58c84c51ad75ad02bf7f6ae66c1b0.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_2698927462cd74613ca0b5baa8a5bc35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_2698927462cd74613ca0b5baa8a5bc35.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_7b244701ea283f091949deb950a6657c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_7b244701ea283f091949deb950a6657c.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_d83fb1f11c8f4c57a6f87582a862ca24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_d83fb1f11c8f4c57a6f87582a862ca24.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_daf59d99e596d7085d588fa7c6caf9fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_daf59d99e596d7085d588fa7c6caf9fb.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_a0559fa09050636f5ea9bdc493d3e17f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a0559fa09050636f5ea9bdc493d3e17f.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_8b2a1f09f41162b167c1293b3f1ad876.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_8b2a1f09f41162b167c1293b3f1ad876.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_4a04d7a7f6d953898a5011d54324a6f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_4a04d7a7f6d953898a5011d54324a6f2.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_a04c7e20c4d13866640e5b0b87f97333.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a04c7e20c4d13866640e5b0b87f97333.jpg already downloaded
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252Ffd%252F51fd8d292ab25e47163f65d5f42e9234%252Fpa%252FFS35820_64bb19ab0e206122df7f9c758c6364e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_64bb19ab0e206122df7f9c758c6364e4.jpg already downloaded
2026-03-30 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78beb3fa-0728-50c4-8cab-b98e7aa3c991, identifier: FS35820
2026-03-30 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78beb3fa-0728-50c4-8cab-b98e7aa3c991 with identifier: FS35820
2026-03-30 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78beb3fa-0728-50c4-8cab-b98e7aa3c991 with identifier: FS35820
2026-03-30 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78beb3fa-0728-50c4-8cab-b98e7aa3c991 with identifier: FS35820 to the API
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FS35820>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:51:54Z',
'fuel_type': 'petrol',
'id': '78beb3fa-0728-50c4-8cab-b98e7aa3c991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS35820',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 104515,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_c2e58c84c51ad75ad02bf7f6ae66c1b0.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_2698927462cd74613ca0b5baa8a5bc35.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_7b244701ea283f091949deb950a6657c.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_d83fb1f11c8f4c57a6f87582a862ca24.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_daf59d99e596d7085d588fa7c6caf9fb.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a0559fa09050636f5ea9bdc493d3e17f.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_8b2a1f09f41162b167c1293b3f1ad876.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_4a04d7a7f6d953898a5011d54324a6f2.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a04c7e20c4d13866640e5b0b87f97333.jpg',
'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_64bb19ab0e206122df7f9c758c6364e4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_c2e58c84c51ad75ad02bf7f6ae66c1b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3166692,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_2698927462cd74613ca0b5baa8a5bc35.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_7b244701ea283f091949deb950a6657c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_d83fb1f11c8f4c57a6f87582a862ca24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_daf59d99e596d7085d588fa7c6caf9fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a0559fa09050636f5ea9bdc493d3e17f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_8b2a1f09f41162b167c1293b3f1ad876.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3155772,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_4a04d7a7f6d953898a5011d54324a6f2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3339948,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_a04c7e20c4d13866640e5b0b87f97333.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78beb3fa-0728-50c4-8cab-b98e7aa3c991/78beb3fa-0728-50c4-8cab-b98e7aa3c991_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2952086,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img51/fd/51fd8d292ab25e47163f65d5f42e9234/pa/FS35820_64bb19ab0e206122df7f9c758c6364e4.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-08',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2012}
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS35820%27 HTTP/1.1" 200 None
2026-03-30 12:11:28 [auto1.it] INFO: Saving data for FS35820: {'created_time': 1774872688.973509, 'last_price_update_time': 1774872688.973519, 'auction_closing_time': 1774972314.0}
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS35820') HTTP/1.1" 204 0
2026-03-30 12:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF79348> (referer: https://www.auto1.com/v1/car-details-view/LF79348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689ac3dc-8ac5-591e-a61d-6d75de380485 with identifier: LF79348
2026-03-30 12:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689ac3dc-8ac5-591e-a61d-6d75de380485 with scrape type 1
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 689ac3dc-8ac5-591e-a61d-6d75de380485
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fab%252F4cab8c8a746c06dc6325d2a619e5edd5%252Fpa%252FLF79348_a93d4ac9d5006465c0f740ad71404787.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_a93d4ac9d5006465c0f740ad71404787.jpg already downloaded
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fab%252F4cab8c8a746c06dc6325d2a619e5edd5%252Fpa%252FLF79348_2950070a692710e7d45f98fbef67852a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_2950070a692710e7d45f98fbef67852a.jpg already downloaded
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fab%252F4cab8c8a746c06dc6325d2a619e5edd5%252Fpa%252FLF79348_5bed039e2501d463792cf174304e4c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_5bed039e2501d463792cf174304e4c13.jpg already downloaded
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fab%252F4cab8c8a746c06dc6325d2a619e5edd5%252Fpa%252FLF79348_4a6b00fa0db36c35007b6796980aa2ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_4a6b00fa0db36c35007b6796980aa2ba.jpg already downloaded
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fab%252F4cab8c8a746c06dc6325d2a619e5edd5%252Fpa%252FLF79348_0e69c2606400df6b1660e0f7e81cc824.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_0e69c2606400df6b1660e0f7e81cc824.jpg already downloaded
2026-03-30 12:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 689ac3dc-8ac5-591e-a61d-6d75de380485, identifier: LF79348
2026-03-30 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 689ac3dc-8ac5-591e-a61d-6d75de380485 with identifier: LF79348
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 689ac3dc-8ac5-591e-a61d-6d75de380485 with identifier: LF79348
2026-03-30 12:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 689ac3dc-8ac5-591e-a61d-6d75de380485 with identifier: LF79348 to the API
2026-03-30 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF79348>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:22:14Z',
'fuel_type': 'gas',
'id': '689ac3dc-8ac5-591e-a61d-6d75de380485',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF79348',
'listing': 'auction',
'location': 'IT, Crema',
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 176376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_a93d4ac9d5006465c0f740ad71404787.jpg',
'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_2950070a692710e7d45f98fbef67852a.jpg',
'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_5bed039e2501d463792cf174304e4c13.jpg',
'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_4a6b00fa0db36c35007b6796980aa2ba.jpg',
'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_0e69c2606400df6b1660e0f7e81cc824.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac3dc-8ac5-591e-a61d-6d75de380485/689ac3dc-8ac5-591e-a61d-6d75de380485_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_a93d4ac9d5006465c0f740ad71404787.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac3dc-8ac5-591e-a61d-6d75de380485/689ac3dc-8ac5-591e-a61d-6d75de380485_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_2950070a692710e7d45f98fbef67852a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac3dc-8ac5-591e-a61d-6d75de380485/689ac3dc-8ac5-591e-a61d-6d75de380485_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_5bed039e2501d463792cf174304e4c13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac3dc-8ac5-591e-a61d-6d75de380485/689ac3dc-8ac5-591e-a61d-6d75de380485_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_4a6b00fa0db36c35007b6796980aa2ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac3dc-8ac5-591e-a61d-6d75de380485/689ac3dc-8ac5-591e-a61d-6d75de380485_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ab/4cab8c8a746c06dc6325d2a619e5edd5/pa/LF79348_0e69c2606400df6b1660e0f7e81cc824.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-01-07',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat Fiorino 1.4 SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2010}
2026-03-30 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF79348%27 HTTP/1.1" 200 None
2026-03-30 12:11:31 [auto1.it] INFO: Saving data for LF79348: {'created_time': 1774872691.444624, 'last_price_update_time': 1774872691.444636, 'auction_closing_time': 1774970534.0}
2026-03-30 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF79348') HTTP/1.1" 204 0
2026-03-30 12:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ31880> (referer: https://www.auto1.com/v1/car-details-view/BJ31880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with identifier: BJ31880
2026-03-30 12:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with scrape type 1
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg not downloaded yet
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg not downloaded yet
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_ca40931837dda427025ef1f8f8b8747f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_ca40931837dda427025ef1f8f8b8747f.jpg not downloaded yet
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_8e46fc6645188b053f8599c35ab271f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_8e46fc6645188b053f8599c35ab271f8.jpg not downloaded yet
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg not downloaded yet
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg not downloaded yet
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg not downloaded yet
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg not downloaded yet
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg not downloaded yet
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_fbc70217f586b74becb4633d1bd73322.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_fbc70217f586b74becb4633d1bd73322.jpg not downloaded yet
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127c3990>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_8e46fc6645188b053f8599c35ab271f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_ca40931837dda427025ef1f8f8b8747f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010917ad0>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_fbc70217f586b74becb4633d1bd73322.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010942110>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a36c90>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_8e46fc6645188b053f8599c35ab271f8.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_8e46fc6645188b053f8599c35ab271f8.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127ce410>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_ca40931837dda427025ef1f8f8b8747f.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_ca40931837dda427025ef1f8f8b8747f.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109384d0>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f427d0>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_fbc70217f586b74becb4633d1bd73322.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_fbc70217f586b74becb4633d1bd73322.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a3a250>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e3710>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109034d0>
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F45%252Fb045bc17c2834952b218dc5548276536%252Fpa%252FBJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg') HTTP/1.1" 204 0
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg saved to cache
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2
2026-03-30 12:11:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: deb31dd5-dc3b-5348-a9c7-e119c95cfff2, skipping ID generation
2026-03-30 12:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with scrape type 1
2026-03-30 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item deb31dd5-dc3b-5348-a9c7-e119c95cfff2 sending to next pipeline
2026-03-30 12:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: deb31dd5-dc3b-5348-a9c7-e119c95cfff2, identifier: BJ31880
2026-03-30 12:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with identifier: BJ31880
2026-03-30 12:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with identifier: BJ31880
2026-03-30 12:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: deb31dd5-dc3b-5348-a9c7-e119c95cfff2 with identifier: BJ31880 to the API
2026-03-30 12:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:52:09Z',
'fuel_type': 'diesel',
'id': 'deb31dd5-dc3b-5348-a9c7-e119c95cfff2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ31880',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Audi',
'model': 'A5',
'odometer': 46954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b795a8cfe468c3f0c9aa0d30f49bbdbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_038e946f667d43ee0c8a7ac5c9071bb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_ca40931837dda427025ef1f8f8b8747f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_8e46fc6645188b053f8599c35ab271f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_b0edfc52f2c6042a21e2194af70915d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_569ca4f5cfd9d86674e482f1cc360e8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_a25901796c9eb8a2b1f05b0fb2bcbf80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_4626bc8dc0a9e97464b451b76f1ced75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_bf70f40f563e40b23fe193e1ede7efe3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb31dd5-dc3b-5348-a9c7-e119c95cfff2/deb31dd5-dc3b-5348-a9c7-e119c95cfff2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/45/b045bc17c2834952b218dc5548276536/pa/BJ31880_fbc70217f586b74becb4633d1bd73322.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-02-17',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 40 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2020}
2026-03-30 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ31880%27 HTTP/1.1" 200 None
2026-03-30 12:11:34 [auto1.it] INFO: Saving data for BJ31880: {'created_time': 1774872694.13747, 'last_price_update_time': 1774872694.137481, 'auction_closing_time': 1774972329.0}
2026-03-30 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ31880') HTTP/1.1" 204 0
2026-03-30 12:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU00285> (referer: https://www.auto1.com/v1/car-details-view/BU00285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c24cba-7058-54e9-9486-e12ba173c387 with identifier: BU00285
2026-03-30 12:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c24cba-7058-54e9-9486-e12ba173c387 with scrape type 1
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 29c24cba-7058-54e9-9486-e12ba173c387
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5d%252F6a5df9412b4e8858c8e9cefa1ebeecf9%252Fpa%252FBU00285_e9308d54fdd3fbccc865f8d7a2e59a59.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_e9308d54fdd3fbccc865f8d7a2e59a59.jpg already downloaded
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5d%252F6a5df9412b4e8858c8e9cefa1ebeecf9%252Fpa%252FBU00285_384771b081b2e58fe1878c69036e83a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_384771b081b2e58fe1878c69036e83a8.jpg already downloaded
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5d%252F6a5df9412b4e8858c8e9cefa1ebeecf9%252Fpa%252FBU00285_61379f4c6c589d546cb7141d51d66945.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_61379f4c6c589d546cb7141d51d66945.jpg already downloaded
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5d%252F6a5df9412b4e8858c8e9cefa1ebeecf9%252Fpa%252FBU00285_5f87d40046b9e868a2c2a47df68a69bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_5f87d40046b9e868a2c2a47df68a69bc.jpg already downloaded
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F5d%252F6a5df9412b4e8858c8e9cefa1ebeecf9%252Fpa%252FBU00285_8dd6be798440bc5feaf4bf47cb7d0d59.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_8dd6be798440bc5feaf4bf47cb7d0d59.jpg already downloaded
2026-03-30 12:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 29c24cba-7058-54e9-9486-e12ba173c387, identifier: BU00285
2026-03-30 12:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 29c24cba-7058-54e9-9486-e12ba173c387 with identifier: BU00285
2026-03-30 12:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 29c24cba-7058-54e9-9486-e12ba173c387 with identifier: BU00285
2026-03-30 12:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 29c24cba-7058-54e9-9486-e12ba173c387 with identifier: BU00285 to the API
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU00285>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:11:42Z',
'fuel_type': 'petrol',
'id': '29c24cba-7058-54e9-9486-e12ba173c387',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU00285',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Ford',
'model': 'B-Max',
'odometer': 218536,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_e9308d54fdd3fbccc865f8d7a2e59a59.jpg',
'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_384771b081b2e58fe1878c69036e83a8.jpg',
'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_61379f4c6c589d546cb7141d51d66945.jpg',
'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_5f87d40046b9e868a2c2a47df68a69bc.jpg',
'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_8dd6be798440bc5feaf4bf47cb7d0d59.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c24cba-7058-54e9-9486-e12ba173c387/29c24cba-7058-54e9-9486-e12ba173c387_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_e9308d54fdd3fbccc865f8d7a2e59a59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c24cba-7058-54e9-9486-e12ba173c387/29c24cba-7058-54e9-9486-e12ba173c387_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_384771b081b2e58fe1878c69036e83a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c24cba-7058-54e9-9486-e12ba173c387/29c24cba-7058-54e9-9486-e12ba173c387_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_61379f4c6c589d546cb7141d51d66945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c24cba-7058-54e9-9486-e12ba173c387/29c24cba-7058-54e9-9486-e12ba173c387_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_5f87d40046b9e868a2c2a47df68a69bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29c24cba-7058-54e9-9486-e12ba173c387/29c24cba-7058-54e9-9486-e12ba173c387_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6a/5d/6a5df9412b4e8858c8e9cefa1ebeecf9/pa/BU00285_8dd6be798440bc5feaf4bf47cb7d0d59.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford B-Max 1.4 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU00285%27 HTTP/1.1" 200 None
2026-03-30 12:11:35 [auto1.it] INFO: Saving data for BU00285: {'created_time': 1774872695.737079, 'last_price_update_time': 1774872695.737092, 'auction_closing_time': 1774969902.0}
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU00285') HTTP/1.1" 204 0
2026-03-30 12:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU07999> (referer: https://www.auto1.com/v1/car-details-view/MU07999/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb54070e-bb9b-5c09-a1c2-056615c0c352 with identifier: MU07999
2026-03-30 12:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb54070e-bb9b-5c09-a1c2-056615c0c352 with scrape type 1
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item eb54070e-bb9b-5c09-a1c2-056615c0c352
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff1%252Fbef1c6a05482e55d1a1209294e888c2b%252Fpa%252FMU07999_451b6c227d1070c7a05c160fad0a4c59.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_451b6c227d1070c7a05c160fad0a4c59.jpg already downloaded
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff1%252Fbef1c6a05482e55d1a1209294e888c2b%252Fpa%252FMU07999_0a193c6d4bc7c2cdd29083072314e80d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_0a193c6d4bc7c2cdd29083072314e80d.jpg already downloaded
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff1%252Fbef1c6a05482e55d1a1209294e888c2b%252Fpa%252FMU07999_68c9cdb812f2119ddb181daa84fa85c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_68c9cdb812f2119ddb181daa84fa85c6.jpg already downloaded
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff1%252Fbef1c6a05482e55d1a1209294e888c2b%252Fpa%252FMU07999_008b5f358c39c751c3a39ee36700b143.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_008b5f358c39c751c3a39ee36700b143.jpg already downloaded
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Ff1%252Fbef1c6a05482e55d1a1209294e888c2b%252Fpa%252FMU07999_88f3e87d7b7e554322e1bcd90fcef98e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_88f3e87d7b7e554322e1bcd90fcef98e.jpg already downloaded
2026-03-30 12:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb54070e-bb9b-5c09-a1c2-056615c0c352, identifier: MU07999
2026-03-30 12:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb54070e-bb9b-5c09-a1c2-056615c0c352 with identifier: MU07999
2026-03-30 12:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb54070e-bb9b-5c09-a1c2-056615c0c352 with identifier: MU07999
2026-03-30 12:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb54070e-bb9b-5c09-a1c2-056615c0c352 with identifier: MU07999 to the API
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU07999>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:50:45Z',
'fuel_type': 'diesel',
'id': 'eb54070e-bb9b-5c09-a1c2-056615c0c352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU07999',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Renault',
'model': 'Megane',
'odometer': 216841,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_451b6c227d1070c7a05c160fad0a4c59.jpg',
'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_0a193c6d4bc7c2cdd29083072314e80d.jpg',
'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_68c9cdb812f2119ddb181daa84fa85c6.jpg',
'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_008b5f358c39c751c3a39ee36700b143.jpg',
'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_88f3e87d7b7e554322e1bcd90fcef98e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb54070e-bb9b-5c09-a1c2-056615c0c352/eb54070e-bb9b-5c09-a1c2-056615c0c352_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_451b6c227d1070c7a05c160fad0a4c59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb54070e-bb9b-5c09-a1c2-056615c0c352/eb54070e-bb9b-5c09-a1c2-056615c0c352_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_0a193c6d4bc7c2cdd29083072314e80d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb54070e-bb9b-5c09-a1c2-056615c0c352/eb54070e-bb9b-5c09-a1c2-056615c0c352_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_68c9cdb812f2119ddb181daa84fa85c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb54070e-bb9b-5c09-a1c2-056615c0c352/eb54070e-bb9b-5c09-a1c2-056615c0c352_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_008b5f358c39c751c3a39ee36700b143.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb54070e-bb9b-5c09-a1c2-056615c0c352/eb54070e-bb9b-5c09-a1c2-056615c0c352_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/f1/bef1c6a05482e55d1a1209294e888c2b/pa/MU07999_88f3e87d7b7e554322e1bcd90fcef98e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU07999%27 HTTP/1.1" 200 None
2026-03-30 12:11:41 [auto1.it] INFO: Saving data for MU07999: {'created_time': 1774872701.252297, 'last_price_update_time': 1774872701.252308, 'auction_closing_time': 1774972245.0}
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU07999') HTTP/1.1" 204 0
2026-03-30 12:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX32747> (referer: https://www.auto1.com/v1/car-details-view/BX32747/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7217477-c7ae-577b-a683-8fa5f933adf1 with identifier: BX32747
2026-03-30 12:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7217477-c7ae-577b-a683-8fa5f933adf1 with scrape type 1
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7217477-c7ae-577b-a683-8fa5f933adf1
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_1a61536885ff3c9eeb2c8d7006d73552.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_1a61536885ff3c9eeb2c8d7006d73552.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_7848a11c55744413ff57d942bb213059.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7848a11c55744413ff57d942bb213059.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_3f3d0ad827a54b90dd941afe5e4919c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_3f3d0ad827a54b90dd941afe5e4919c7.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_9d8528066a5f416955516a01632101c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_9d8528066a5f416955516a01632101c6.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_ab95ef912c6b30c9fd92c2c0a83c3bb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_ab95ef912c6b30c9fd92c2c0a83c3bb5.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_fc00e71c10b7d554fe5f47f99a1bae26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_fc00e71c10b7d554fe5f47f99a1bae26.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_087b8581baa4d9fbe8f400aafa880e72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_087b8581baa4d9fbe8f400aafa880e72.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_a4c53511560d0d5095fb7f639721a934.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_a4c53511560d0d5095fb7f639721a934.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_7f753b374647ff3c62b37948caee84eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7f753b374647ff3c62b37948caee84eb.jpg already downloaded
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Fbc%252Fc7bcb546ee4a89027601c52360b5036a%252Fpa%252FBX32747_dd55dbbfb412a9f21c55b09bd4294b45.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_dd55dbbfb412a9f21c55b09bd4294b45.jpg already downloaded
2026-03-30 12:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7217477-c7ae-577b-a683-8fa5f933adf1, identifier: BX32747
2026-03-30 12:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7217477-c7ae-577b-a683-8fa5f933adf1 with identifier: BX32747
2026-03-30 12:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7217477-c7ae-577b-a683-8fa5f933adf1 with identifier: BX32747
2026-03-30 12:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7217477-c7ae-577b-a683-8fa5f933adf1 with identifier: BX32747 to the API
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX32747>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 204,
'expiration_date': '2026-03-31T15:03:07Z',
'fuel_type': 'diesel',
'id': 'f7217477-c7ae-577b-a683-8fa5f933adf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX32747',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Audi',
'model': 'A6',
'odometer': 92810,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_1a61536885ff3c9eeb2c8d7006d73552.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7848a11c55744413ff57d942bb213059.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_3f3d0ad827a54b90dd941afe5e4919c7.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_9d8528066a5f416955516a01632101c6.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_ab95ef912c6b30c9fd92c2c0a83c3bb5.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_fc00e71c10b7d554fe5f47f99a1bae26.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_087b8581baa4d9fbe8f400aafa880e72.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_a4c53511560d0d5095fb7f639721a934.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7f753b374647ff3c62b37948caee84eb.jpg',
'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_dd55dbbfb412a9f21c55b09bd4294b45.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_1a61536885ff3c9eeb2c8d7006d73552.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7848a11c55744413ff57d942bb213059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_3f3d0ad827a54b90dd941afe5e4919c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_9d8528066a5f416955516a01632101c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_ab95ef912c6b30c9fd92c2c0a83c3bb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_fc00e71c10b7d554fe5f47f99a1bae26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_087b8581baa4d9fbe8f400aafa880e72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_a4c53511560d0d5095fb7f639721a934.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2095888,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_7f753b374647ff3c62b37948caee84eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7217477-c7ae-577b-a683-8fa5f933adf1/f7217477-c7ae-577b-a683-8fa5f933adf1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/bc/c7bcb546ee4a89027601c52360b5036a/pa/BX32747_dd55dbbfb412a9f21c55b09bd4294b45.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2021}
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX32747%27 HTTP/1.1" 200 None
2026-03-30 12:11:43 [auto1.it] INFO: Saving data for BX32747: {'created_time': 1774872703.855998, 'last_price_update_time': 1774872703.856009, 'auction_closing_time': 1774969387.0}
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BX32747') HTTP/1.1" 204 0
2026-03-30 12:12:04 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 10 pages/min), scraped 15 items (at 8 items/min)
2026-03-30 12:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.278(s), this was the 1st time calling it.
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.140431972022845 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.301(s), this was the 1st time calling it.
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.655565525020812 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.442(s), this was the 1st time calling it.
2026-03-30 12:12:11 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.2289999127694085 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.270(s), this was the 1st time calling it.
2026-03-30 12:12:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.165488306655765 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.820(s), this was the 1st time calling it.
2026-03-30 12:12:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.412761409148787 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC33505> (referer: https://www.auto1.com/v1/car-details-view/WC33505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f425ec-e715-5317-ae43-f97eec4ccddc with identifier: WC33505
2026-03-30 12:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f425ec-e715-5317-ae43-f97eec4ccddc with scrape type 1
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6f425ec-e715-5317-ae43-f97eec4ccddc
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_eb64738093431f4faaacd6fd42413fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_eb64738093431f4faaacd6fd42413fbd.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_be57a5c8d7c627fbf55c3265bfc790b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_be57a5c8d7c627fbf55c3265bfc790b4.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_638752a7c570ceb0303969c387cc3c3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_638752a7c570ceb0303969c387cc3c3d.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_4b67d8427ca3237a8194db8ab64fdcfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4b67d8427ca3237a8194db8ab64fdcfe.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_4c746bea7c2c59a608b76a49be60ebb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4c746bea7c2c59a608b76a49be60ebb3.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_2c17c98c45589a2766293ac72ff5fac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2c17c98c45589a2766293ac72ff5fac4.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_1c344f4ce70f8d06e93d76ba7a9a7969.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1c344f4ce70f8d06e93d76ba7a9a7969.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_ff5a7995b6472f250994d17ba95ace14.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_ff5a7995b6472f250994d17ba95ace14.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_2fca887b3a5b21b3f95dd07ca0c2e064.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2fca887b3a5b21b3f95dd07ca0c2e064.jpg already downloaded
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fee%252F73ee1a20823f4889d7cd6aaa6e67aaa4%252Fpa%252FWC33505_1413a8dc93a5917ccda9c39b98fe7114.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1413a8dc93a5917ccda9c39b98fe7114.jpg already downloaded
2026-03-30 12:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6f425ec-e715-5317-ae43-f97eec4ccddc, identifier: WC33505
2026-03-30 12:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6f425ec-e715-5317-ae43-f97eec4ccddc with identifier: WC33505
2026-03-30 12:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6f425ec-e715-5317-ae43-f97eec4ccddc with identifier: WC33505
2026-03-30 12:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6f425ec-e715-5317-ae43-f97eec4ccddc with identifier: WC33505 to the API
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC33505>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:42:10Z',
'fuel_type': 'diesel',
'id': 'c6f425ec-e715-5317-ae43-f97eec4ccddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC33505',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 165036,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_eb64738093431f4faaacd6fd42413fbd.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_be57a5c8d7c627fbf55c3265bfc790b4.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_638752a7c570ceb0303969c387cc3c3d.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4b67d8427ca3237a8194db8ab64fdcfe.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4c746bea7c2c59a608b76a49be60ebb3.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2c17c98c45589a2766293ac72ff5fac4.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1c344f4ce70f8d06e93d76ba7a9a7969.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_ff5a7995b6472f250994d17ba95ace14.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2fca887b3a5b21b3f95dd07ca0c2e064.jpg',
'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1413a8dc93a5917ccda9c39b98fe7114.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2559760,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_eb64738093431f4faaacd6fd42413fbd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673472,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_be57a5c8d7c627fbf55c3265bfc790b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_638752a7c570ceb0303969c387cc3c3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4b67d8427ca3237a8194db8ab64fdcfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2448446,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_4c746bea7c2c59a608b76a49be60ebb3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2c17c98c45589a2766293ac72ff5fac4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1c344f4ce70f8d06e93d76ba7a9a7969.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_ff5a7995b6472f250994d17ba95ace14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_2fca887b3a5b21b3f95dd07ca0c2e064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6f425ec-e715-5317-ae43-f97eec4ccddc/c6f425ec-e715-5317-ae43-f97eec4ccddc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2469125,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/ee/73ee1a20823f4889d7cd6aaa6e67aaa4/pa/WC33505_1413a8dc93a5917ccda9c39b98fe7114.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai ix35 2.0 CRDi Comfort AWD',
'transmission': 'manual',
'trim': 'Comfort AWD',
'year': 2011}
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC33505%27 HTTP/1.1" 200 None
2026-03-30 12:12:54 [auto1.it] INFO: Saving data for WC33505: {'created_time': 1774872774.530226, 'last_price_update_time': 1774872774.53024, 'auction_closing_time': 1774971730.0}
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WC33505') HTTP/1.1" 204 0
2026-03-30 12:13:04 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 1 pages/min), scraped 16 items (at 1 items/min)
2026-03-30 12:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:14:04 [scrapy.extensions.logstats] INFO: Crawled 22 pages (at 0 pages/min), scraped 16 items (at 0 items/min)
2026-03-30 12:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:14:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.605(s), this was the 2nd time calling it.
2026-03-30 12:14:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8399845729335915 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.513(s), this was the 2nd time calling it.
2026-03-30 12:14:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.228461480175958 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.494(s), this was the 2nd time calling it.
2026-03-30 12:14:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.62303230772271 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:31 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3572 | hits on page: 40
2026-03-30 12:14:31 [auto1.it] INFO: Found listing with ID: EC77761
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC77761%27 HTTP/1.1" 200 None
2026-03-30 12:14:31 [auto1.it] INFO: Scrape type for EC77761: 2
2026-03-30 12:14:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c315901b-6604-55c2-82e4-de1055d8abe5 with identifier: EC77761
2026-03-30 12:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c315901b-6604-55c2-82e4-de1055d8abe5 with scrape type 2
2026-03-30 12:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c315901b-6604-55c2-82e4-de1055d8abe5 with scrape type 2
2026-03-30 12:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c315901b-6604-55c2-82e4-de1055d8abe5, identifier: EC77761
2026-03-30 12:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c315901b-6604-55c2-82e4-de1055d8abe5 with identifier: EC77761
2026-03-30 12:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c315901b-6604-55c2-82e4-de1055d8abe5 with identifier: EC77761
2026-03-30 12:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c315901b-6604-55c2-82e4-de1055d8abe5 with identifier: EC77761 to the API
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:10:49Z',
'fuel_type': 'petrol',
'id': 'c315901b-6604-55c2-82e4-de1055d8abe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC77761',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 50172,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2022}
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC77761%27 HTTP/1.1" 200 None
2026-03-30 12:14:31 [auto1.it] INFO: Saving data for EC77761: {'auction_closing_time': 1774969849.0, 'created_time': 1774267685.56594, 'last_price_update_time': 1774872871.925033}
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC77761') HTTP/1.1" 204 0
2026-03-30 12:14:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:31 [auto1.it] INFO: Found listing with ID: GZ29938
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29938%27 HTTP/1.1" 200 None
2026-03-30 12:14:31 [auto1.it] INFO: Scrape type for GZ29938: 1
2026-03-30 12:14:31 [auto1.it] INFO: Found listing with ID: CR80060
2026-03-30 12:14:31 [auto1.it] INFO: Found listing with ID: KH27402
2026-03-30 12:14:31 [auto1.it] INFO: Found listing with ID: WW82904
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW82904%27 HTTP/1.1" 200 None
2026-03-30 12:14:31 [auto1.it] INFO: Scrape type for WW82904: 1
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: PW81398
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: JN64307
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN64307%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for JN64307: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: JE46327
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: BX32747
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX32747%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for BX32747: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: ZY39181
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: VN14179
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: CA07652
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: YF54958
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: TW76525
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: BJ31880
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ31880%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for BJ31880: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: EC16043
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: PL88180
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: LA31709
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA31709%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for LA31709: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: BU00285
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU00285%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for BU00285: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: BL12748
2026-03-30 12:14:32 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/BL12748/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: DR86004
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: KR59858
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: HZ90603
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: TU32641
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: LF79348
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF79348%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for LF79348: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: AS60977
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: YP27472
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: GB77184
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB77184%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for GB77184: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: ZK14239
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: LD85970
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD85970%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for LD85970: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: WC33505
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC33505%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for WC33505: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: SC05628
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05628%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for SC05628: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: VT28696
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: MU07999
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU07999%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for MU07999: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: WM56672
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: SZ97857
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ97857%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for SZ97857: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: SA54199
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA54199%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for SA54199: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: YV27723
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: LV97351
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV97351%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for LV97351: 0
2026-03-30 12:14:32 [auto1.it] INFO: Found listing with ID: DV12691
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV12691%27 HTTP/1.1" 200 None
2026-03-30 12:14:32 [auto1.it] INFO: Scrape type for DV12691: 0
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR86004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:34 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3572 | hits on page: 40
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: XY45587
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: ED01256
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: FS35820
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS35820%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for FS35820: 0
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: LR19944
2026-03-30 12:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: RH06885
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: HZ18199
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: JU45224
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: HW42540
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW42540%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for HW42540: 1
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: PB42062
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB42062%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for PB42062: 2
2026-03-30 12:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b398a391-88df-5187-b3d8-3c4c4bc9b0fe with identifier: PB42062
2026-03-30 12:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b398a391-88df-5187-b3d8-3c4c4bc9b0fe with scrape type 2
2026-03-30 12:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b398a391-88df-5187-b3d8-3c4c4bc9b0fe with scrape type 2
2026-03-30 12:14:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b398a391-88df-5187-b3d8-3c4c4bc9b0fe, identifier: PB42062
2026-03-30 12:14:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b398a391-88df-5187-b3d8-3c4c4bc9b0fe with identifier: PB42062
2026-03-30 12:14:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b398a391-88df-5187-b3d8-3c4c4bc9b0fe with identifier: PB42062
2026-03-30 12:14:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b398a391-88df-5187-b3d8-3c4c4bc9b0fe with identifier: PB42062 to the API
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:58:17Z',
'fuel_type': 'diesel',
'id': 'b398a391-88df-5187-b3d8-3c4c4bc9b0fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB42062',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 328030,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-20',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB42062%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Saving data for PB42062: {'auction_closing_time': 1774972697.0, 'created_time': 1774526723.36216, 'last_price_update_time': 1774872874.586901}
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PB42062') HTTP/1.1" 204 0
2026-03-30 12:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: CT98540
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: NP50044
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP50044%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for NP50044: 1
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: XR48250
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: AZ46754
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ46754%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for AZ46754: 1
2026-03-30 12:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: ZP20614
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: HU34790
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU34790%27 HTTP/1.1" 200 None
2026-03-30 12:14:34 [auto1.it] INFO: Scrape type for HU34790: 1
2026-03-30 12:14:34 [auto1.it] INFO: Found listing with ID: NM89065
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM89065%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [auto1.it] INFO: Scrape type for NM89065: 1
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: RT28596
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: AP54101
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: AU19307
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: WB03158
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: ZK56465
2026-03-30 12:14:35 [auto1.it] INFO: Found listing with ID: KR63254
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR63254%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [auto1.it] INFO: Scrape type for KR63254: 2
2026-03-30 12:14:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57734091-9a3f-5802-95c8-1a313692ed76 with identifier: KR63254
2026-03-30 12:14:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57734091-9a3f-5802-95c8-1a313692ed76 with scrape type 2
2026-03-30 12:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57734091-9a3f-5802-95c8-1a313692ed76 with scrape type 2
2026-03-30 12:14:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57734091-9a3f-5802-95c8-1a313692ed76, identifier: KR63254
2026-03-30 12:14:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57734091-9a3f-5802-95c8-1a313692ed76 with identifier: KR63254
2026-03-30 12:14:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57734091-9a3f-5802-95c8-1a313692ed76 with identifier: KR63254
2026-03-30 12:14:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57734091-9a3f-5802-95c8-1a313692ed76 with identifier: KR63254 to the API
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:36:21Z',
'fuel_type': 'gas',
'id': '57734091-9a3f-5802-95c8-1a313692ed76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR63254',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 87485,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-20',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2020}
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR63254%27 HTTP/1.1" 200 None
2026-03-30 12:14:35 [auto1.it] INFO: Saving data for KR63254: {'auction_closing_time': 1774971381.0, 'created_time': 1774127296.875684, 'last_price_update_time': 1774872875.897155}
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR63254') HTTP/1.1" 204 0
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: AH00208
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH00208%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for AH00208: 1
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: YA14646
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: DY67922
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY67922%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for DY67922: 1
2026-03-30 12:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: WG93177
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: ES44185
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44185%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for ES44185: 1
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: SU93171
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU93171%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for SU93171: 1
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: SU79271
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU79271%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for SU79271: 2
2026-03-30 12:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f924b3c-438f-5131-af26-cf84f84bbdb9 with identifier: SU79271
2026-03-30 12:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f924b3c-438f-5131-af26-cf84f84bbdb9 with scrape type 2
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f924b3c-438f-5131-af26-cf84f84bbdb9 with scrape type 2
2026-03-30 12:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f924b3c-438f-5131-af26-cf84f84bbdb9, identifier: SU79271
2026-03-30 12:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f924b3c-438f-5131-af26-cf84f84bbdb9 with identifier: SU79271
2026-03-30 12:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f924b3c-438f-5131-af26-cf84f84bbdb9 with identifier: SU79271
2026-03-30 12:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f924b3c-438f-5131-af26-cf84f84bbdb9 with identifier: SU79271 to the API
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:33:51Z',
'fuel_type': 'diesel',
'id': '1f924b3c-438f-5131-af26-cf84f84bbdb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU79271',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 207374,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-13',
'seller_name': None,
'title': 'BMW X1 sDrive 16d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU79271%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Saving data for SU79271: {'auction_closing_time': 1774971231.0, 'created_time': 1773129703.909336, 'last_price_update_time': 1774872876.715135}
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU79271') HTTP/1.1" 204 0
2026-03-30 12:14:36 [auto1.it] INFO: Found listing with ID: CF00214
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF00214%27 HTTP/1.1" 200 None
2026-03-30 12:14:36 [auto1.it] INFO: Scrape type for CF00214: 2
2026-03-30 12:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b89e34b-40a6-55f4-82a1-5ecca79485cb with identifier: CF00214
2026-03-30 12:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b89e34b-40a6-55f4-82a1-5ecca79485cb with scrape type 2
2026-03-30 12:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b89e34b-40a6-55f4-82a1-5ecca79485cb with scrape type 2
2026-03-30 12:14:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b89e34b-40a6-55f4-82a1-5ecca79485cb, identifier: CF00214
2026-03-30 12:14:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b89e34b-40a6-55f4-82a1-5ecca79485cb with identifier: CF00214
2026-03-30 12:14:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b89e34b-40a6-55f4-82a1-5ecca79485cb with identifier: CF00214
2026-03-30 12:14:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b89e34b-40a6-55f4-82a1-5ecca79485cb with identifier: CF00214 to the API
2026-03-30 12:14:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:19:23Z',
'fuel_type': 'diesel',
'id': '7b89e34b-40a6-55f4-82a1-5ecca79485cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF00214',
'listing': 'auction',
'make': 'Opel',
'model': 'Antara',
'odometer': 93198,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-29',
'seller_name': None,
'title': 'Opel Antara 2.2 CDTI Cosmo Unlimited-Pack 4x4',
'transmission': 'automatic',
'trim': 'Cosmo Unlimited-Pack 4x4',
'year': 2014}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF00214%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Saving data for CF00214: {'auction_closing_time': 1774970363.0, 'created_time': 1773129770.522772, 'last_price_update_time': 1774872877.245585}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CF00214') HTTP/1.1" 204 0
2026-03-30 12:14:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.217(s), this was the 2nd time calling it.
2026-03-30 12:14:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.938965823984278 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:14:37 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3572 | hits on page: 40
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: PJ81187
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: GK45626
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK45626%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Scrape type for GK45626: 2
2026-03-30 12:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed2fcea5-2675-577c-9fda-61a34e23ef43 with identifier: GK45626
2026-03-30 12:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed2fcea5-2675-577c-9fda-61a34e23ef43 with scrape type 2
2026-03-30 12:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed2fcea5-2675-577c-9fda-61a34e23ef43 with scrape type 2
2026-03-30 12:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed2fcea5-2675-577c-9fda-61a34e23ef43, identifier: GK45626
2026-03-30 12:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed2fcea5-2675-577c-9fda-61a34e23ef43 with identifier: GK45626
2026-03-30 12:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed2fcea5-2675-577c-9fda-61a34e23ef43 with identifier: GK45626
2026-03-30 12:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed2fcea5-2675-577c-9fda-61a34e23ef43 with identifier: GK45626 to the API
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:30:57Z',
'fuel_type': 'petrol',
'id': 'ed2fcea5-2675-577c-9fda-61a34e23ef43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK45626',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 172895,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-17',
'seller_name': None,
'title': 'Fiat 500L 1.4 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2016}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK45626%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Saving data for GK45626: {'auction_closing_time': 1774971057.0, 'created_time': 1772784325.746962, 'last_price_update_time': 1774872877.854278}
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK45626') HTTP/1.1" 204 0
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: LJ06904
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: PV39721
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: GJ73639
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: UK29912
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: SR04136
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: DH07036
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH07036%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Scrape type for DH07036: 1
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: JR88134
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: KC58223
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: TB03240
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB03240%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Scrape type for TB03240: 1
2026-03-30 12:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP50044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: US48000
2026-03-30 12:14:37 [auto1.it] INFO: Found listing with ID: KS49913
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS49913%27 HTTP/1.1" 200 None
2026-03-30 12:14:37 [auto1.it] INFO: Scrape type for KS49913: 2
2026-03-30 12:14:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-30 12:14:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with scrape type 2
2026-03-30 12:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with scrape type 2
2026-03-30 12:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7, identifier: KS49913
2026-03-30 12:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:38 [auto1.it] INFO: Found listing with ID: TH34027
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH34027%27 HTTP/1.1" 200 None
2026-03-30 12:14:38 [auto1.it] INFO: Scrape type for TH34027: 2
2026-03-30 12:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with identifier: TH34027
2026-03-30 12:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with scrape type 2
2026-03-30 12:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with scrape type 2
2026-03-30 12:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3, identifier: TH34027
2026-03-30 12:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-30 12:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913
2026-03-30 12:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7 with identifier: KS49913 to the API
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:22:16Z',
'fuel_type': 'petrol',
'id': 'b60ffd63-ddf0-50ea-9d1a-f4d51034cbc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS49913',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 69026,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-28',
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS49913%27 HTTP/1.1" 200 None
2026-03-30 12:14:38 [auto1.it] INFO: Saving data for KS49913: {'auction_closing_time': 1774970536.0, 'created_time': 1773328005.547618, 'last_price_update_time': 1774872878.519189}
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KS49913') HTTP/1.1" 204 0
2026-03-30 12:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with identifier: TH34027
2026-03-30 12:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with identifier: TH34027
2026-03-30 12:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3 with identifier: TH34027 to the API
2026-03-30 12:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:07:33Z',
'fuel_type': 'diesel',
'id': '86b2b472-0aa8-5ca6-ac9e-bd8ababe4ca3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH34027',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 106019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-22',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2014}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH34027%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Saving data for TH34027: {'auction_closing_time': 1774969653.0, 'created_time': 1774040987.802007, 'last_price_update_time': 1774872879.199717}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH34027') HTTP/1.1" 204 0
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: SC68564
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: JG80585
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: CB01824
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: HH18683
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: ME96207
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME96207%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for ME96207: 2
2026-03-30 12:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec593fd3-1543-5850-87a7-5dc011fd516d with identifier: ME96207
2026-03-30 12:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec593fd3-1543-5850-87a7-5dc011fd516d with scrape type 2
2026-03-30 12:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec593fd3-1543-5850-87a7-5dc011fd516d with scrape type 2
2026-03-30 12:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec593fd3-1543-5850-87a7-5dc011fd516d, identifier: ME96207
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: ZD69250
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: KS45370
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: HS18644
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS18644%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for HS18644: 1
2026-03-30 12:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec593fd3-1543-5850-87a7-5dc011fd516d with identifier: ME96207
2026-03-30 12:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec593fd3-1543-5850-87a7-5dc011fd516d with identifier: ME96207
2026-03-30 12:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec593fd3-1543-5850-87a7-5dc011fd516d with identifier: ME96207 to the API
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:07:20Z',
'fuel_type': 'diesel',
'id': 'ec593fd3-1543-5850-87a7-5dc011fd516d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME96207',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 110420,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'Suzuki Swift 1.3 DDiS B-Easy',
'transmission': 'manual',
'trim': 'B-Easy',
'year': 2013}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME96207%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Saving data for ME96207: {'auction_closing_time': 1774969640.0, 'created_time': 1772609007.205767, 'last_price_update_time': 1774872879.800635}
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME96207') HTTP/1.1" 204 0
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: CZ86305
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ86305%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for CZ86305: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: BS49157
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS49157%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for BS49157: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: JT27907
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT27907%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for JT27907: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: LF40578
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF40578%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for LF40578: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: MD78742
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: VC19367
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: CR89969
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR89969%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for CR89969: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: WA13410
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: GR51690
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR51690%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for GR51690: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: VC69599
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC69599%27 HTTP/1.1" 200 None
2026-03-30 12:14:39 [auto1.it] INFO: Scrape type for VC69599: 1
2026-03-30 12:14:39 [auto1.it] INFO: Found listing with ID: LU33475
2026-03-30 12:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU33475%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Scrape type for LU33475: 1
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: LT57228
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT57228%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Scrape type for LT57228: 2
2026-03-30 12:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with identifier: LT57228
2026-03-30 12:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with scrape type 2
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with scrape type 2
2026-03-30 12:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c, identifier: LT57228
2026-03-30 12:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with identifier: LT57228
2026-03-30 12:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with identifier: LT57228
2026-03-30 12:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c with identifier: LT57228 to the API
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:40:51Z',
'fuel_type': 'diesel',
'id': '57b4eb06-c10b-5d45-9c7d-e2515d5c4c4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT57228',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 283588,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-19',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2015}
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT57228%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Saving data for LT57228: {'auction_closing_time': 1774971651.0, 'created_time': 1773137752.687321, 'last_price_update_time': 1774872880.521274}
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT57228') HTTP/1.1" 204 0
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: TB03261
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: MU03391
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: LS98728
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: MZ46636
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: RV86134
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: ZM05911
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: RD45958
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD45958%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Scrape type for RD45958: 1
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: FT95535
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: RX28669
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX28669%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Scrape type for RX28669: 1
2026-03-30 12:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ46754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: EK49781
2026-03-30 12:14:40 [auto1.it] INFO: Found listing with ID: WW42874
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW42874%27 HTTP/1.1" 200 None
2026-03-30 12:14:40 [auto1.it] INFO: Scrape type for WW42874: 2
2026-03-30 12:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23bf912a-f4b5-5209-9de3-373a744f03be with identifier: WW42874
2026-03-30 12:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23bf912a-f4b5-5209-9de3-373a744f03be with scrape type 2
2026-03-30 12:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23bf912a-f4b5-5209-9de3-373a744f03be with scrape type 2
2026-03-30 12:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 23bf912a-f4b5-5209-9de3-373a744f03be, identifier: WW42874
2026-03-30 12:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 23bf912a-f4b5-5209-9de3-373a744f03be with identifier: WW42874
2026-03-30 12:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 23bf912a-f4b5-5209-9de3-373a744f03be with identifier: WW42874
2026-03-30 12:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 23bf912a-f4b5-5209-9de3-373a744f03be with identifier: WW42874 to the API
2026-03-30 12:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-31T15:07:13Z',
'fuel_type': 'petrol',
'id': '23bf912a-f4b5-5209-9de3-373a744f03be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW42874',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 43984,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-09',
'seller_name': None,
'title': 'Kia Picanto 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2020}
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW42874%27 HTTP/1.1" 200 None
2026-03-30 12:14:41 [auto1.it] INFO: Saving data for WW42874: {'auction_closing_time': 1774969633.0, 'created_time': 1774267825.692761, 'last_price_update_time': 1774872881.327848}
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW42874') HTTP/1.1" 204 0
2026-03-30 12:14:41 [auto1.it] INFO: Found listing with ID: NE32513
2026-03-30 12:14:41 [auto1.it] INFO: Found listing with ID: AX13883
2026-03-30 12:14:41 [auto1.it] INFO: Found listing with ID: XA59652
2026-03-30 12:14:41 [auto1.it] INFO: Found listing with ID: PW02999
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW02999%27 HTTP/1.1" 200 None
2026-03-30 12:14:41 [auto1.it] INFO: Scrape type for PW02999: 1
2026-03-30 12:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU34790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:41 [auto1.it] INFO: Found listing with ID: ZH09001
2026-03-30 12:14:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR86004> (referer: https://www.auto1.com/v1/car-details-view/DR86004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa506755-5c3c-5127-8052-a197fdcd0688 with identifier: DR86004
2026-03-30 12:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa506755-5c3c-5127-8052-a197fdcd0688 with scrape type 1
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa506755-5c3c-5127-8052-a197fdcd0688
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_53d5b93d3a9287ab5099ac7a9d902394.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_53d5b93d3a9287ab5099ac7a9d902394.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_b48776f1fc3d28baf27d56950da05f51.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_b48776f1fc3d28baf27d56950da05f51.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_8f4a52d77a6f47ece031fc093b9dcee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_8f4a52d77a6f47ece031fc093b9dcee3.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_2055369392445f85adde3d8bb2132f3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_2055369392445f85adde3d8bb2132f3b.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_c796d3e7fb2d385e924fc0cc5a8dee62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_c796d3e7fb2d385e924fc0cc5a8dee62.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_1877846b0006ea117e34fa1461cfe530.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_1877846b0006ea117e34fa1461cfe530.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_e5ba3d121f4a1916e9a5562f8bc65f35.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_e5ba3d121f4a1916e9a5562f8bc65f35.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_11f22b0494a7050a5c0444856913bb3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_11f22b0494a7050a5c0444856913bb3b.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_915c67ea54e0291bffde2abd6ee00892.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_915c67ea54e0291bffde2abd6ee00892.jpg already downloaded
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fb6%252Fe4b67975173c6b5b1f3d0a7088ead423%252Fpa%252FDR86004_50bb52ffa667e48bd57a08101236488f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_50bb52ffa667e48bd57a08101236488f.jpg already downloaded
2026-03-30 12:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa506755-5c3c-5127-8052-a197fdcd0688, identifier: DR86004
2026-03-30 12:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa506755-5c3c-5127-8052-a197fdcd0688 with identifier: DR86004
2026-03-30 12:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa506755-5c3c-5127-8052-a197fdcd0688 with identifier: DR86004
2026-03-30 12:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa506755-5c3c-5127-8052-a197fdcd0688 with identifier: DR86004 to the API
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR86004>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-03-31T15:45:26Z',
'fuel_type': 'petrol',
'id': 'aa506755-5c3c-5127-8052-a197fdcd0688',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR86004',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Fiat',
'model': '500',
'odometer': 12537,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_53d5b93d3a9287ab5099ac7a9d902394.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_b48776f1fc3d28baf27d56950da05f51.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_8f4a52d77a6f47ece031fc093b9dcee3.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_2055369392445f85adde3d8bb2132f3b.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_c796d3e7fb2d385e924fc0cc5a8dee62.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_1877846b0006ea117e34fa1461cfe530.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_e5ba3d121f4a1916e9a5562f8bc65f35.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_11f22b0494a7050a5c0444856913bb3b.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_915c67ea54e0291bffde2abd6ee00892.jpg',
'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_50bb52ffa667e48bd57a08101236488f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2837436,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_53d5b93d3a9287ab5099ac7a9d902394.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2727184,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_b48776f1fc3d28baf27d56950da05f51.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2900412,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_8f4a52d77a6f47ece031fc093b9dcee3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2830332,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_2055369392445f85adde3d8bb2132f3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2772340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_c796d3e7fb2d385e924fc0cc5a8dee62.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2926100,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_1877846b0006ea117e34fa1461cfe530.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2745904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_e5ba3d121f4a1916e9a5562f8bc65f35.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2811621,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_11f22b0494a7050a5c0444856913bb3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_915c67ea54e0291bffde2abd6ee00892.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa506755-5c3c-5127-8052-a197fdcd0688/aa506755-5c3c-5127-8052-a197fdcd0688_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117533,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/b6/e4b67975173c6b5b1f3d0a7088ead423/pa/DR86004_50bb52ffa667e48bd57a08101236488f.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR86004%27 HTTP/1.1" 200 None
2026-03-30 12:14:43 [auto1.it] INFO: Saving data for DR86004: {'created_time': 1774872883.820331, 'last_price_update_time': 1774872883.820343, 'auction_closing_time': 1774971926.0}
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR86004') HTTP/1.1" 204 0
2026-03-30 12:14:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR19944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW42540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY67922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU93171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:14:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:14:59 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3572 | hits on page: 40
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: HB45776
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB45776%27 HTTP/1.1" 200 None
2026-03-30 12:14:59 [auto1.it] INFO: Scrape type for HB45776: 1
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: BJ48417
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: EZ15465
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: XE85483
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: WA81173
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: CD58410
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: UB32589
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: ZT64960
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64960%27 HTTP/1.1" 200 None
2026-03-30 12:14:59 [auto1.it] INFO: Scrape type for ZT64960: 1
2026-03-30 12:14:59 [auto1.it] INFO: Found listing with ID: LG11604
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11604%27 HTTP/1.1" 200 None
2026-03-30 12:14:59 [auto1.it] INFO: Scrape type for LG11604: 2
2026-03-30 12:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f58a30-1f64-584f-ad7f-5a3053f99940 with identifier: LG11604
2026-03-30 12:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f58a30-1f64-584f-ad7f-5a3053f99940 with scrape type 2
2026-03-30 12:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f58a30-1f64-584f-ad7f-5a3053f99940 with scrape type 2
2026-03-30 12:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4f58a30-1f64-584f-ad7f-5a3053f99940, identifier: LG11604
2026-03-30 12:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4f58a30-1f64-584f-ad7f-5a3053f99940 with identifier: LG11604
2026-03-30 12:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4f58a30-1f64-584f-ad7f-5a3053f99940 with identifier: LG11604
2026-03-30 12:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4f58a30-1f64-584f-ad7f-5a3053f99940 with identifier: LG11604 to the API
2026-03-30 12:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:37:27Z',
'fuel_type': 'petrol',
'id': 'd4f58a30-1f64-584f-ad7f-5a3053f99940',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG11604',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 102882,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-05',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Silver',
'transmission': 'manual',
'trim': 'Silver',
'year': 2018}
2026-03-30 12:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG11604%27 HTTP/1.1" 200 None
2026-03-30 12:15:00 [auto1.it] INFO: Saving data for LG11604: {'auction_closing_time': 1774971447.0, 'created_time': 1774084017.522342, 'last_price_update_time': 1774872900.960744}
2026-03-30 12:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG11604') HTTP/1.1" 204 0
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: SR32433
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: YN88559
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: VM48251
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM48251%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for VM48251: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: PK61043
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK61043%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for PK61043: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: WE01478
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: AL46390
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: KT96933
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT96933%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for KT96933: 0
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: RM78765
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM78765%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for RM78765: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: MK84348
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: RF43400
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: YC73046
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC73046%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for YC73046: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: CH56891
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: LH73352
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: YY61336
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY61336%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for YY61336: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: RM76590
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: EZ54353
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: SK78603
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: HT47075
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: AD56901
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: XK66363
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: FE29361
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE29361%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for FE29361: 1
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: XN19641
2026-03-30 12:15:01 [auto1.it] INFO: Found listing with ID: RX05887
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX05887%27 HTTP/1.1" 200 None
2026-03-30 12:15:01 [auto1.it] INFO: Scrape type for RX05887: 2
2026-03-30 12:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca5140f5-22da-5178-8c6a-f57fc79555e1 with identifier: RX05887
2026-03-30 12:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca5140f5-22da-5178-8c6a-f57fc79555e1 with scrape type 2
2026-03-30 12:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca5140f5-22da-5178-8c6a-f57fc79555e1 with scrape type 2
2026-03-30 12:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca5140f5-22da-5178-8c6a-f57fc79555e1, identifier: RX05887
2026-03-30 12:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca5140f5-22da-5178-8c6a-f57fc79555e1 with identifier: RX05887
2026-03-30 12:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca5140f5-22da-5178-8c6a-f57fc79555e1 with identifier: RX05887
2026-03-30 12:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca5140f5-22da-5178-8c6a-f57fc79555e1 with identifier: RX05887 to the API
2026-03-30 12:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:21:57Z',
'fuel_type': 'diesel',
'id': 'ca5140f5-22da-5178-8c6a-f57fc79555e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX05887',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 200417,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-22',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2015}
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX05887%27 HTTP/1.1" 200 None
2026-03-30 12:15:02 [auto1.it] INFO: Saving data for RX05887: {'auction_closing_time': 1774970517.0, 'created_time': 1772627372.508978, 'last_price_update_time': 1774872902.163017}
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX05887') HTTP/1.1" 204 0
2026-03-30 12:15:02 [auto1.it] INFO: Found listing with ID: XA55908
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA55908%27 HTTP/1.1" 200 None
2026-03-30 12:15:02 [auto1.it] INFO: Scrape type for XA55908: 2
2026-03-30 12:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with identifier: XA55908
2026-03-30 12:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with scrape type 2
2026-03-30 12:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with scrape type 2
2026-03-30 12:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af, identifier: XA55908
2026-03-30 12:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with identifier: XA55908
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 12:15:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with identifier: XA55908
2026-03-30 12:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af with identifier: XA55908 to the API
2026-03-30 12:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:32:03Z',
'fuel_type': 'petrol',
'id': '556f70d7-d04a-5dc6-b4aa-fb1d3ddf54af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA55908',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 108165,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-22',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2017}
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA55908%27 HTTP/1.1" 200 None
2026-03-30 12:15:03 [auto1.it] INFO: Saving data for XA55908: {'auction_closing_time': 1774971123.0, 'created_time': 1774094877.530787, 'last_price_update_time': 1774872903.452111}
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XA55908') HTTP/1.1" 204 0
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: VF11016
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: NE35927
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: ZJ84869
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: NS08410
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS08410%27 HTTP/1.1" 200 None
2026-03-30 12:15:03 [auto1.it] INFO: Scrape type for NS08410: 1
2026-03-30 12:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB03240/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: MR48932
2026-03-30 12:15:03 [auto1.it] INFO: Found listing with ID: LT27562
2026-03-30 12:15:04 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 14 pages/min), scraped 31 items (at 15 items/min)
2026-03-30 12:15:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD45958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ46754> (referer: https://www.auto1.com/v1/car-details-view/AZ46754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with identifier: AZ46754
2026-03-30 12:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with scrape type 1
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_ec1f82500182a589942ef8173b8e209f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ec1f82500182a589942ef8173b8e209f.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_a85dda67e6fa45876045110be016370f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_a85dda67e6fa45876045110be016370f.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg not downloaded yet
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_91c9561609678ffd39a93d1b45c27309.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_91c9561609678ffd39a93d1b45c27309.jpg not downloaded yet
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_d989999de303ec57e3ddb08086fd60e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_d989999de303ec57e3ddb08086fd60e6.jpg not downloaded yet
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_dd2679380602bb38754cc8da0493532f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_dd2679380602bb38754cc8da0493532f.jpg not downloaded yet
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg not downloaded yet
2026-03-30 12:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL12748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601281be10>
2026-03-30 12:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:11 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-30 12:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg saved to cache
2026-03-30 12:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU34790> (referer: https://www.auto1.com/v1/car-details-view/HU34790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4ace6ce-2503-59ce-a4cd-70f9f0185567 with identifier: HU34790
2026-03-30 12:15:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4ace6ce-2503-59ce-a4cd-70f9f0185567 with scrape type 1
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4ace6ce-2503-59ce-a4cd-70f9f0185567
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_4e31afce4c1c55beb989052f1306bb62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_4e31afce4c1c55beb989052f1306bb62.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_2c374160f6466da67d7243ae3bda8096.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_2c374160f6466da67d7243ae3bda8096.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_91a46bf7011c2eca61e099c60f7000a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_91a46bf7011c2eca61e099c60f7000a9.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_ae16ebc6d6e3267c6a757ff8e29ad957.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ae16ebc6d6e3267c6a757ff8e29ad957.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_601002eae16c89e7271c6bed7359cedd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_601002eae16c89e7271c6bed7359cedd.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_ad585d099936451061366d1d2b244c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ad585d099936451061366d1d2b244c96.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_973199d68511cfd46671e0cea58f2860.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_973199d68511cfd46671e0cea58f2860.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_966b413735960f87373a11675edd2872.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_966b413735960f87373a11675edd2872.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_cc1e2765fb8f72dc9f785cc1bbe66a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_cc1e2765fb8f72dc9f785cc1bbe66a4a.jpg already downloaded
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F11%252Fdd113ab8fd46d88b526bac0969bc524c%252Fpa%252FHU34790_22c92e54e4d7abdd50aa2f88dd6c414e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_22c92e54e4d7abdd50aa2f88dd6c414e.jpg already downloaded
2026-03-30 12:15:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4ace6ce-2503-59ce-a4cd-70f9f0185567, identifier: HU34790
2026-03-30 12:15:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4ace6ce-2503-59ce-a4cd-70f9f0185567 with identifier: HU34790
2026-03-30 12:15:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4ace6ce-2503-59ce-a4cd-70f9f0185567 with identifier: HU34790
2026-03-30 12:15:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4ace6ce-2503-59ce-a4cd-70f9f0185567 with identifier: HU34790 to the API
2026-03-30 12:15:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU34790>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:22:10Z',
'fuel_type': 'petrol',
'id': 'e4ace6ce-2503-59ce-a4cd-70f9f0185567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU34790',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Ford',
'model': 'Focus',
'odometer': 48699,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_4e31afce4c1c55beb989052f1306bb62.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_2c374160f6466da67d7243ae3bda8096.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_91a46bf7011c2eca61e099c60f7000a9.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ae16ebc6d6e3267c6a757ff8e29ad957.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_601002eae16c89e7271c6bed7359cedd.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ad585d099936451061366d1d2b244c96.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_973199d68511cfd46671e0cea58f2860.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_966b413735960f87373a11675edd2872.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_cc1e2765fb8f72dc9f785cc1bbe66a4a.jpg',
'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_22c92e54e4d7abdd50aa2f88dd6c414e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_4e31afce4c1c55beb989052f1306bb62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_2c374160f6466da67d7243ae3bda8096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_91a46bf7011c2eca61e099c60f7000a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ae16ebc6d6e3267c6a757ff8e29ad957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_601002eae16c89e7271c6bed7359cedd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_ad585d099936451061366d1d2b244c96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_973199d68511cfd46671e0cea58f2860.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_966b413735960f87373a11675edd2872.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_cc1e2765fb8f72dc9f785cc1bbe66a4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4ace6ce-2503-59ce-a4cd-70f9f0185567/e4ace6ce-2503-59ce-a4cd-70f9f0185567_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/11/dd113ab8fd46d88b526bac0969bc524c/pa/HU34790_22c92e54e4d7abdd50aa2f88dd6c414e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2022}
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU34790%27 HTTP/1.1" 200 None
2026-03-30 12:15:19 [auto1.it] INFO: Saving data for HU34790: {'created_time': 1774872919.1638, 'last_price_update_time': 1774872919.16381, 'auction_closing_time': 1774970530.0}
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU34790') HTTP/1.1" 204 0
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_dd2679380602bb38754cc8da0493532f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW02999/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601281ab10>
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_dd2679380602bb38754cc8da0493532f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_dd2679380602bb38754cc8da0493532f.jpg saved to cache
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_d989999de303ec57e3ddb08086fd60e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010915e50>
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_d989999de303ec57e3ddb08086fd60e6.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_d989999de303ec57e3ddb08086fd60e6.jpg saved to cache
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_91c9561609678ffd39a93d1b45c27309.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f85dd0>
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_91c9561609678ffd39a93d1b45c27309.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_91c9561609678ffd39a93d1b45c27309.jpg saved to cache
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5e050>
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg saved to cache
2026-03-30 12:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc6410>
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg saved to cache
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_a85dda67e6fa45876045110be016370f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601090bf90>
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_a85dda67e6fa45876045110be016370f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_a85dda67e6fa45876045110be016370f.jpg saved to cache
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e25a10>
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg saved to cache
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ec1f82500182a589942ef8173b8e209f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES44185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5ec90>
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_ec1f82500182a589942ef8173b8e209f.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ec1f82500182a589942ef8173b8e209f.jpg saved to cache
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010915290>
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F5f%252Ff35ff1d52171f351f0f743b916432715%252Fpa%252FAZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg saved to cache
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab
2026-03-30 12:15:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab, skipping ID generation
2026-03-30 12:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with scrape type 1
2026-03-30 12:15:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab sending to next pipeline
2026-03-30 12:15:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab, identifier: AZ46754
2026-03-30 12:15:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with identifier: AZ46754
2026-03-30 12:15:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with identifier: AZ46754
2026-03-30 12:15:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab with identifier: AZ46754 to the API
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:44:08Z',
'fuel_type': 'hybrid',
'id': '7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ46754',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Ford',
'model': 'Kuga',
'odometer': 107903,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40584,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_6ab54eff2e9167dfbc50674124524c5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ec1f82500182a589942ef8173b8e209f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40694,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_ac103fd5bb82407c1b09c22bc4d74e25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38214,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_a85dda67e6fa45876045110be016370f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32441,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cdfd87e4299ede3b77c62447707ccdd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39928,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_4f8a82832d256898d0c9df8d87e82ff4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37752,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_91c9561609678ffd39a93d1b45c27309.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40739,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_d989999de303ec57e3ddb08086fd60e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33154,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_dd2679380602bb38754cc8da0493532f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab/7af5eac1-c5ce-58e9-b26c-eb5e60ca5bab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/5f/f35ff1d52171f351f0f743b916432715/pa/AZ46754_cd1beb0b05ae83c821485a7feafbb374.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2023}
2026-03-30 12:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ46754%27 HTTP/1.1" 200 None
2026-03-30 12:15:21 [auto1.it] INFO: Saving data for AZ46754: {'created_time': 1774872921.005026, 'last_price_update_time': 1774872921.005036, 'auction_closing_time': 1774971848.0}
2026-03-30 12:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AZ46754') HTTP/1.1" 204 0
2026-03-30 12:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR19944> (referer: https://www.auto1.com/v1/car-details-view/LR19944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 132ffc6b-efac-57f7-ac1f-fea0e6daf07b with identifier: LR19944
2026-03-30 12:15:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 132ffc6b-efac-57f7-ac1f-fea0e6daf07b with scrape type 1
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 132ffc6b-efac-57f7-ac1f-fea0e6daf07b
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_6d28a8c907ff99799a8339a7fe54d66f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_6d28a8c907ff99799a8339a7fe54d66f.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_457e5e37f4a86c5d56b150e6a634e4f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_457e5e37f4a86c5d56b150e6a634e4f3.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_9f4c5a2bffd1df3f52ddb8967f66b4ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_9f4c5a2bffd1df3f52ddb8967f66b4ce.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_ffe72a6e6f82e783059fef8da4cbfc01.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ffe72a6e6f82e783059fef8da4cbfc01.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_bfa5efbe0b9b05a7608afbefa02ddebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_bfa5efbe0b9b05a7608afbefa02ddebc.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_ca1058437ec89a000e8001dd46fc0b1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ca1058437ec89a000e8001dd46fc0b1f.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_8da5009538c83e7b3ace0c13ad417d73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_8da5009538c83e7b3ace0c13ad417d73.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_605316054cc2834bf5f22dd18a0d8851.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_605316054cc2834bf5f22dd18a0d8851.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_09857a802e994bb19b3c16901f9105a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_09857a802e994bb19b3c16901f9105a4.jpg already downloaded
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb8%252F1bb821e501a34bca15868d9a5399993c%252Fpa%252FLR19944_cb83a1afd4db4f3c9334bea03a76b7a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_cb83a1afd4db4f3c9334bea03a76b7a8.jpg already downloaded
2026-03-30 12:15:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 132ffc6b-efac-57f7-ac1f-fea0e6daf07b, identifier: LR19944
2026-03-30 12:15:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 132ffc6b-efac-57f7-ac1f-fea0e6daf07b with identifier: LR19944
2026-03-30 12:15:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 132ffc6b-efac-57f7-ac1f-fea0e6daf07b with identifier: LR19944
2026-03-30 12:15:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 132ffc6b-efac-57f7-ac1f-fea0e6daf07b with identifier: LR19944 to the API
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR19944>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:31:31Z',
'fuel_type': 'diesel',
'id': '132ffc6b-efac-57f7-ac1f-fea0e6daf07b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR19944',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 232873,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_6d28a8c907ff99799a8339a7fe54d66f.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_457e5e37f4a86c5d56b150e6a634e4f3.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_9f4c5a2bffd1df3f52ddb8967f66b4ce.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ffe72a6e6f82e783059fef8da4cbfc01.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_bfa5efbe0b9b05a7608afbefa02ddebc.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ca1058437ec89a000e8001dd46fc0b1f.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_8da5009538c83e7b3ace0c13ad417d73.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_605316054cc2834bf5f22dd18a0d8851.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_09857a802e994bb19b3c16901f9105a4.jpg',
'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_cb83a1afd4db4f3c9334bea03a76b7a8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_6d28a8c907ff99799a8339a7fe54d66f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_457e5e37f4a86c5d56b150e6a634e4f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_9f4c5a2bffd1df3f52ddb8967f66b4ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2346496,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ffe72a6e6f82e783059fef8da4cbfc01.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_bfa5efbe0b9b05a7608afbefa02ddebc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_ca1058437ec89a000e8001dd46fc0b1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_8da5009538c83e7b3ace0c13ad417d73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_605316054cc2834bf5f22dd18a0d8851.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_09857a802e994bb19b3c16901f9105a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46063577-5631-505e-8413-4de59677efe9/46063577-5631-505e-8413-4de59677efe9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b8/1bb821e501a34bca15868d9a5399993c/pa/LR19944_cb83a1afd4db4f3c9334bea03a76b7a8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2011}
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR19944%27 HTTP/1.1" 200 None
2026-03-30 12:15:27 [auto1.it] INFO: Saving data for LR19944: {'created_time': 1774872927.277882, 'last_price_update_time': 1774872927.277895, 'auction_closing_time': 1774971091.0}
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR19944') HTTP/1.1" 204 0
2026-03-30 12:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY67922> (referer: https://www.auto1.com/v1/car-details-view/DY67922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 668331ac-7444-55e7-9b10-ea21d04c2412 with identifier: DY67922
2026-03-30 12:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 668331ac-7444-55e7-9b10-ea21d04c2412 with scrape type 1
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_87c7f30ab13b055c82e88a8510f680fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_87c7f30ab13b055c82e88a8510f680fe.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_0592ee405216e186bc1ba855d69aa468.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0592ee405216e186bc1ba855d69aa468.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_71da174b9649ea01f1999bb632e943ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_71da174b9649ea01f1999bb632e943ac.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_8c50d5ca678373a042cb8f4db08050a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_8c50d5ca678373a042cb8f4db08050a8.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_54de184fcdb58f83aca1e57959a90570.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_54de184fcdb58f83aca1e57959a90570.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_d2487c7052557afd2f98531200d525a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_d2487c7052557afd2f98531200d525a7.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_e64331374cbaf5165792de1295c5f880.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_e64331374cbaf5165792de1295c5f880.jpg not downloaded yet
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_4046755c88dfa653432c4343341dc9b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_4046755c88dfa653432c4343341dc9b0.jpg not downloaded yet
2026-03-30 12:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU93171> (referer: https://www.auto1.com/v1/car-details-view/SU93171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e921c6f-ab07-50ae-8d3b-f240760c979d with identifier: SU93171
2026-03-30 12:15:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e921c6f-ab07-50ae-8d3b-f240760c979d with scrape type 1
2026-03-30 12:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e921c6f-ab07-50ae-8d3b-f240760c979d
2026-03-30 12:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_f3b874709567990dd29ab23e0da2647e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_f3b874709567990dd29ab23e0da2647e.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_58091196c9234ff893f825a50e4563f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_58091196c9234ff893f825a50e4563f6.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_61029ab32308f0464d07925e5e94c2b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_61029ab32308f0464d07925e5e94c2b7.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_ad3d727c8666a4e70b0482c8e06a1201.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ad3d727c8666a4e70b0482c8e06a1201.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_e7e2274ada9c4ed48df818e9f28522b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_e7e2274ada9c4ed48df818e9f28522b3.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_a6b83cc390578b0a3b9698391143c086.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_a6b83cc390578b0a3b9698391143c086.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_82a2a385660889243e123ed5ec4195e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_82a2a385660889243e123ed5ec4195e8.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_ed012b840c76cd4f23fc5e60a8b4ce47.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ed012b840c76cd4f23fc5e60a8b4ce47.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_38fa802b24c4742d2846aaf899f474ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_38fa802b24c4742d2846aaf899f474ec.jpg already downloaded
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F2d%252Ffe2db59f6500465ebe158bfa75eeeb32%252Fpa%252FSU93171_2a4785723eb7efcf7a7ffcca303f49eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_2a4785723eb7efcf7a7ffcca303f49eb.jpg already downloaded
2026-03-30 12:15:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e921c6f-ab07-50ae-8d3b-f240760c979d, identifier: SU93171
2026-03-30 12:15:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e921c6f-ab07-50ae-8d3b-f240760c979d with identifier: SU93171
2026-03-30 12:15:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e921c6f-ab07-50ae-8d3b-f240760c979d with identifier: SU93171
2026-03-30 12:15:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e921c6f-ab07-50ae-8d3b-f240760c979d with identifier: SU93171 to the API
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU93171>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 106,
'expiration_date': '2026-03-31T15:11:45Z',
'fuel_type': 'petrol',
'id': '4e921c6f-ab07-50ae-8d3b-f240760c979d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU93171',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'MG',
'model': 'ZS',
'odometer': 35606,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_f3b874709567990dd29ab23e0da2647e.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_58091196c9234ff893f825a50e4563f6.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_61029ab32308f0464d07925e5e94c2b7.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ad3d727c8666a4e70b0482c8e06a1201.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_e7e2274ada9c4ed48df818e9f28522b3.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_a6b83cc390578b0a3b9698391143c086.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_82a2a385660889243e123ed5ec4195e8.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ed012b840c76cd4f23fc5e60a8b4ce47.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_38fa802b24c4742d2846aaf899f474ec.jpg',
'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_2a4785723eb7efcf7a7ffcca303f49eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_f3b874709567990dd29ab23e0da2647e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_58091196c9234ff893f825a50e4563f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_61029ab32308f0464d07925e5e94c2b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858066,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ad3d727c8666a4e70b0482c8e06a1201.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 858066,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_e7e2274ada9c4ed48df818e9f28522b3.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_a6b83cc390578b0a3b9698391143c086.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777941,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_82a2a385660889243e123ed5ec4195e8.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777941,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_ed012b840c76cd4f23fc5e60a8b4ce47.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_38fa802b24c4742d2846aaf899f474ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e921c6f-ab07-50ae-8d3b-f240760c979d/4e921c6f-ab07-50ae-8d3b-f240760c979d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379797,
'Height': 1440,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/2d/fe2db59f6500465ebe158bfa75eeeb32/pa/SU93171_2a4785723eb7efcf7a7ffcca303f49eb.jpg',
'Width': 1920}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'MG ZS 1.5 VTi Luxury',
'transmission': 'manual',
'trim': 'Luxury',
'year': 2024}
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU93171%27 HTTP/1.1" 200 None
2026-03-30 12:15:35 [auto1.it] INFO: Saving data for SU93171: {'created_time': 1774872935.580659, 'last_price_update_time': 1774872935.58067, 'auction_closing_time': 1774969905.0}
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU93171') HTTP/1.1" 204 0
2026-03-30 12:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_4046755c88dfa653432c4343341dc9b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a355d0>
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_4046755c88dfa653432c4343341dc9b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_4046755c88dfa653432c4343341dc9b0.jpg saved to cache
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_e64331374cbaf5165792de1295c5f880.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010939bd0>
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_e64331374cbaf5165792de1295c5f880.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_e64331374cbaf5165792de1295c5f880.jpg saved to cache
2026-03-30 12:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_d2487c7052557afd2f98531200d525a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f98c50>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_d2487c7052557afd2f98531200d525a7.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_d2487c7052557afd2f98531200d525a7.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b03610>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_54de184fcdb58f83aca1e57959a90570.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb5e50>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_54de184fcdb58f83aca1e57959a90570.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_54de184fcdb58f83aca1e57959a90570.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010940190>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_8c50d5ca678373a042cb8f4db08050a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_71da174b9649ea01f1999bb632e943ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e13090>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_8c50d5ca678373a042cb8f4db08050a8.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_8c50d5ca678373a042cb8f4db08050a8.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010909ed0>
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_71da174b9649ea01f1999bb632e943ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_71da174b9649ea01f1999bb632e943ac.jpg saved to cache
2026-03-30 12:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0592ee405216e186bc1ba855d69aa468.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_87c7f30ab13b055c82e88a8510f680fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb7790>
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_0592ee405216e186bc1ba855d69aa468.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0592ee405216e186bc1ba855d69aa468.jpg saved to cache
2026-03-30 12:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc7050>
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F9b%252F4a9bce6918ae6b6d2d6a586c110357fe%252Fpa%252FDY67922_87c7f30ab13b055c82e88a8510f680fe.jpg') HTTP/1.1" 204 0
2026-03-30 12:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_87c7f30ab13b055c82e88a8510f680fe.jpg saved to cache
2026-03-30 12:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 668331ac-7444-55e7-9b10-ea21d04c2412
2026-03-30 12:15:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 668331ac-7444-55e7-9b10-ea21d04c2412, skipping ID generation
2026-03-30 12:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 668331ac-7444-55e7-9b10-ea21d04c2412 with scrape type 1
2026-03-30 12:15:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 668331ac-7444-55e7-9b10-ea21d04c2412 sending to next pipeline
2026-03-30 12:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 668331ac-7444-55e7-9b10-ea21d04c2412, identifier: DY67922
2026-03-30 12:15:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 668331ac-7444-55e7-9b10-ea21d04c2412 with identifier: DY67922
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 12:15:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:15:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 668331ac-7444-55e7-9b10-ea21d04c2412 with identifier: DY67922
2026-03-30 12:15:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 668331ac-7444-55e7-9b10-ea21d04c2412 with identifier: DY67922 to the API
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_87c7f30ab13b055c82e88a8510f680fe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:56:29Z',
'fuel_type': 'diesel',
'id': '668331ac-7444-55e7-9b10-ea21d04c2412',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY67922',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 100156,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_87c7f30ab13b055c82e88a8510f680fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0592ee405216e186bc1ba855d69aa468.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_71da174b9649ea01f1999bb632e943ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_8c50d5ca678373a042cb8f4db08050a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_de37f1d7adfb82aeaf381e0169364e6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_54de184fcdb58f83aca1e57959a90570.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_0a3f1773c1b6b8a213dfc1c70eea62b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_d2487c7052557afd2f98531200d525a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_e64331374cbaf5165792de1295c5f880.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_668331ac-7444-55e7-9b10-ea21d04c2412/668331ac-7444-55e7-9b10-ea21d04c2412_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/9b/4a9bce6918ae6b6d2d6a586c110357fe/pa/DY67922_4046755c88dfa653432c4343341dc9b0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY67922%27 HTTP/1.1" 200 None
2026-03-30 12:15:37 [auto1.it] INFO: Saving data for DY67922: {'created_time': 1774872937.93494, 'last_price_update_time': 1774872937.934971, 'auction_closing_time': 1774972589.0}
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY67922') HTTP/1.1" 204 0
2026-03-30 12:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW42540> (referer: https://www.auto1.com/v1/car-details-view/HW42540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:15:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-03-30 12:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with scrape type 1
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_f0f7eaf30a423e21689a445bb751ff51.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_92dc253c5c99f7b0037875ea4cad6097.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_ca4d66332e7317812367536a4da5578a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_f1f339267911872429dda550bbb09726.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_502e0358aef8c0944168980706c16ecf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_3d5691a6781610fad29a19a6c8e62be8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_6d16c6b1d218619282124a873c71a291.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg already downloaded
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F01%252F6801f57736042e19b00b54d493171457%252Fpa%252FHW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg already downloaded
2026-03-30 12:15:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a066538d-7da0-5fa1-9ad8-d49e9e4dd038, identifier: HW42540
2026-03-30 12:15:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-03-30 12:15:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-03-30 12:15:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540 to the API
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:15:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW42540>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:02:40Z',
'fuel_type': 'diesel',
'id': 'a066538d-7da0-5fa1-9ad8-d49e9e4dd038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW42540',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 113222,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg',
'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2325092,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406454,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280249,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2561968,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2416641,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2277004,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2313406,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2018}
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW42540%27 HTTP/1.1" 200 None
2026-03-30 12:15:56 [auto1.it] INFO: Saving data for HW42540: {'created_time': 1774872956.965266, 'last_price_update_time': 1774872956.965276, 'auction_closing_time': 1774969360.0}
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW42540') HTTP/1.1" 204 0
2026-03-30 12:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE29361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:04 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 11 pages/min), scraped 37 items (at 6 items/min)
2026-03-30 12:16:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL12748> (referer: https://www.auto1.com/v1/car-details-view/BL12748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-03-30 12:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with scrape type 1
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_51df954e4b45d2bb562cca060469c839.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_6a148500a756b094ca9d555e7655cf04.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_46f596026f6c6214bea8147e33368f67.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_4904efe0d6f26894d45ad71f47933ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_e306414df04bbf0feabcbf71158bfde2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_ee410d645c4cae5b5c4df86001431062.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg already downloaded
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252Ffa%252Fb3fa91bb5a4a0d0c68c017dc330271f0%252Fpa%252FBL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg already downloaded
2026-03-30 12:16:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef, identifier: BL12748
2026-03-30 12:16:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-03-30 12:16:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-03-30 12:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748 to the API
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL12748>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:35:50Z',
'fuel_type': 'diesel',
'id': '2bf212b9-e1b8-57c0-9e7b-978bd89960ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL12748',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Peugeot',
'model': '2008',
'odometer': 33835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg',
'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2445827,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2425758,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL12748%27 HTTP/1.1" 200 None
2026-03-30 12:16:19 [auto1.it] INFO: Saving data for BL12748: {'created_time': 1774872979.553726, 'last_price_update_time': 1774872979.553737, 'auction_closing_time': 1774971350.0}
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL12748') HTTP/1.1" 204 0
2026-03-30 12:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD45958> (referer: https://www.auto1.com/v1/car-details-view/RD45958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 571341db-916b-59ef-8fda-aa231e6931df with identifier: RD45958
2026-03-30 12:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 571341db-916b-59ef-8fda-aa231e6931df with scrape type 1
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_6ff464c5a55e5aa83b9f749374049dec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_6ff464c5a55e5aa83b9f749374049dec.jpg not downloaded yet
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg not downloaded yet
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_5303c2cec121dd62eb609ead51727b4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_5303c2cec121dd62eb609ead51727b4c.jpg not downloaded yet
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_9172922ccd81bb6431174ae471152104.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_9172922ccd81bb6431174ae471152104.jpg not downloaded yet
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg not downloaded yet
2026-03-30 12:16:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.463(s), this was the 1st time calling it.
2026-03-30 12:16:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.504699031400481 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.350(s), this was the 1st time calling it.
2026-03-30 12:16:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6814022548724346 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW82904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010915090>
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg saved to cache
2026-03-30 12:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ29938/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_9172922ccd81bb6431174ae471152104.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b00dd0>
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_9172922ccd81bb6431174ae471152104.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_9172922ccd81bb6431174ae471152104.jpg saved to cache
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB03240> (referer: https://www.auto1.com/v1/car-details-view/TB03240/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b147539-f3e0-5f39-9d93-be75243213b9 with identifier: TB03240
2026-03-30 12:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b147539-f3e0-5f39-9d93-be75243213b9 with scrape type 1
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7b147539-f3e0-5f39-9d93-be75243213b9
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F7e%252F287e4feb584631bfacdabdf7df5c7c66%252Fpa%252FTB03240_436a93ca105c40082da1859f920dff73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_436a93ca105c40082da1859f920dff73.jpg already downloaded
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F7e%252F287e4feb584631bfacdabdf7df5c7c66%252Fpa%252FTB03240_2e20c8d7bfdc65f7d62c0292f32215e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_2e20c8d7bfdc65f7d62c0292f32215e8.jpg already downloaded
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F7e%252F287e4feb584631bfacdabdf7df5c7c66%252Fpa%252FTB03240_054b3ef78a044c0e197f82512365f071.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_054b3ef78a044c0e197f82512365f071.jpg already downloaded
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F7e%252F287e4feb584631bfacdabdf7df5c7c66%252Fpa%252FTB03240_af351c2da304d1a67f3c3c80b2ac0d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_af351c2da304d1a67f3c3c80b2ac0d79.jpg already downloaded
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F7e%252F287e4feb584631bfacdabdf7df5c7c66%252Fpa%252FTB03240_65ab9582189a2507efd57d5290bb1e53.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_65ab9582189a2507efd57d5290bb1e53.jpg already downloaded
2026-03-30 12:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7b147539-f3e0-5f39-9d93-be75243213b9, identifier: TB03240
2026-03-30 12:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7b147539-f3e0-5f39-9d93-be75243213b9 with identifier: TB03240
2026-03-30 12:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7b147539-f3e0-5f39-9d93-be75243213b9 with identifier: TB03240
2026-03-30 12:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7b147539-f3e0-5f39-9d93-be75243213b9 with identifier: TB03240 to the API
2026-03-30 12:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB03240>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:10:15Z',
'fuel_type': 'diesel',
'id': '7b147539-f3e0-5f39-9d93-be75243213b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB03240',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Peugeot',
'model': '3008',
'odometer': 250959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_436a93ca105c40082da1859f920dff73.jpg',
'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_2e20c8d7bfdc65f7d62c0292f32215e8.jpg',
'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_054b3ef78a044c0e197f82512365f071.jpg',
'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_af351c2da304d1a67f3c3c80b2ac0d79.jpg',
'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_65ab9582189a2507efd57d5290bb1e53.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b147539-f3e0-5f39-9d93-be75243213b9/7b147539-f3e0-5f39-9d93-be75243213b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_436a93ca105c40082da1859f920dff73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b147539-f3e0-5f39-9d93-be75243213b9/7b147539-f3e0-5f39-9d93-be75243213b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_2e20c8d7bfdc65f7d62c0292f32215e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b147539-f3e0-5f39-9d93-be75243213b9/7b147539-f3e0-5f39-9d93-be75243213b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_054b3ef78a044c0e197f82512365f071.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b147539-f3e0-5f39-9d93-be75243213b9/7b147539-f3e0-5f39-9d93-be75243213b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_af351c2da304d1a67f3c3c80b2ac0d79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b147539-f3e0-5f39-9d93-be75243213b9/7b147539-f3e0-5f39-9d93-be75243213b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/7e/287e4feb584631bfacdabdf7df5c7c66/pa/TB03240_65ab9582189a2507efd57d5290bb1e53.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Platinum',
'transmission': 'automatic',
'trim': 'Platinum',
'year': 2009}
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB03240%27 HTTP/1.1" 200 None
2026-03-30 12:16:51 [auto1.it] INFO: Saving data for TB03240: {'created_time': 1774873011.175367, 'last_price_update_time': 1774873011.175379, 'auction_closing_time': 1774969815.0}
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB03240') HTTP/1.1" 204 0
2026-03-30 12:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_5303c2cec121dd62eb609ead51727b4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601efd9c50>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_5303c2cec121dd62eb609ead51727b4c.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_5303c2cec121dd62eb609ead51727b4c.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_6ff464c5a55e5aa83b9f749374049dec.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5c590>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012820c50>
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F9e%252F359e7391503a8ad57ea0620bf725a586%252Fpa%252FRD45958_6ff464c5a55e5aa83b9f749374049dec.jpg') HTTP/1.1" 204 0
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_6ff464c5a55e5aa83b9f749374049dec.jpg saved to cache
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 571341db-916b-59ef-8fda-aa231e6931df
2026-03-30 12:16:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 571341db-916b-59ef-8fda-aa231e6931df, skipping ID generation
2026-03-30 12:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 571341db-916b-59ef-8fda-aa231e6931df with scrape type 1
2026-03-30 12:16:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 571341db-916b-59ef-8fda-aa231e6931df sending to next pipeline
2026-03-30 12:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 571341db-916b-59ef-8fda-aa231e6931df, identifier: RD45958
2026-03-30 12:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 571341db-916b-59ef-8fda-aa231e6931df with identifier: RD45958
2026-03-30 12:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 571341db-916b-59ef-8fda-aa231e6931df with identifier: RD45958
2026-03-30 12:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 571341db-916b-59ef-8fda-aa231e6931df with identifier: RD45958 to the API
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_6ff464c5a55e5aa83b9f749374049dec.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:13:31Z',
'fuel_type': 'petrol',
'id': '571341db-916b-59ef-8fda-aa231e6931df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD45958',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Smart',
'model': 'fortwo',
'odometer': 209638,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_6ff464c5a55e5aa83b9f749374049dec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_7aa869366a448f4d7a460c8d6c4f5d66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_5303c2cec121dd62eb609ead51727b4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_9172922ccd81bb6431174ae471152104.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_571341db-916b-59ef-8fda-aa231e6931df/571341db-916b-59ef-8fda-aa231e6931df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/9e/359e7391503a8ad57ea0620bf725a586/pa/RD45958_0a5013329cfbc07f2df2909cea7c0b7e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-09-24',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pulse',
'year': 2009}
2026-03-30 12:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD45958%27 HTTP/1.1" 200 None
2026-03-30 12:16:52 [auto1.it] INFO: Saving data for RD45958: {'created_time': 1774873012.097018, 'last_price_update_time': 1774873012.097028, 'auction_closing_time': 1774970011.0}
2026-03-30 12:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD45958') HTTP/1.1" 204 0
2026-03-30 12:16:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.394(s), this was the 1st time calling it.
2026-03-30 12:16:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.69171163994947 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.626(s), this was the 1st time calling it.
2026-03-30 12:16:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.945836731204716 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:16:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:16:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:17:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM89065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS08410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK61043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:04 [scrapy.extensions.logstats] INFO: Crawled 55 pages (at 8 pages/min), scraped 40 items (at 3 items/min)
2026-03-30 12:17:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:17:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM48251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM78765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.035(s), this was the 1st time calling it.
2026-03-30 12:17:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.661596231163609 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT64960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES44185> (referer: https://www.auto1.com/v1/car-details-view/ES44185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c with identifier: ES44185
2026-03-30 12:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c with scrape type 1
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_56c2df38b8f1fb316db9888db3bbefea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_56c2df38b8f1fb316db9888db3bbefea.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_df283359e71eb5c457a2c25a23826ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_df283359e71eb5c457a2c25a23826ff1.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_75bcdb116b2724f67bc5f6701b64ff9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_75bcdb116b2724f67bc5f6701b64ff9f.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_2dd1d524992f1983df406cf0bb8d3892.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_2dd1d524992f1983df406cf0bb8d3892.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_a72a5d7761b4f7597197e95d2e54f1ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_a72a5d7761b4f7597197e95d2e54f1ba.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_9d5ba0d01c508c2a7deeb38b7f6953f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_9d5ba0d01c508c2a7deeb38b7f6953f7.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_7aa37fd12c11b6cb68012a8d3b738b71.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_7aa37fd12c11b6cb68012a8d3b738b71.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_05c69bcce00e7bce9297978944a081f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_05c69bcce00e7bce9297978944a081f8.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_97e0170653f14bd8a076b1b58270ca4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_97e0170653f14bd8a076b1b58270ca4b.jpg already downloaded
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fb4%252Fc4b40e2a92aaad710da99e6b1cea28de%252Fpa%252FES44185_919b2dd8aa28df21e70e4e84d4c96b32.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_919b2dd8aa28df21e70e4e84d4c96b32.jpg already downloaded
2026-03-30 12:17:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c, identifier: ES44185
2026-03-30 12:17:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c with identifier: ES44185
2026-03-30 12:17:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c with identifier: ES44185
2026-03-30 12:17:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a89464f-51ba-5bbd-aea5-c2bcffefbc2c with identifier: ES44185 to the API
2026-03-30 12:17:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ES44185>
{'auction_title': '',
'c_o_2_emission_value': 45,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 341,
'expiration_date': '2026-03-31T15:28:51Z',
'fuel_type': 'hybrid',
'id': '9a89464f-51ba-5bbd-aea5-c2bcffefbc2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES44185',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Volvo',
'model': 'XC60',
'odometer': 89448,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_56c2df38b8f1fb316db9888db3bbefea.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_df283359e71eb5c457a2c25a23826ff1.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_75bcdb116b2724f67bc5f6701b64ff9f.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_2dd1d524992f1983df406cf0bb8d3892.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_a72a5d7761b4f7597197e95d2e54f1ba.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_9d5ba0d01c508c2a7deeb38b7f6953f7.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_7aa37fd12c11b6cb68012a8d3b738b71.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_05c69bcce00e7bce9297978944a081f8.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_97e0170653f14bd8a076b1b58270ca4b.jpg',
'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_919b2dd8aa28df21e70e4e84d4c96b32.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_56c2df38b8f1fb316db9888db3bbefea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_df283359e71eb5c457a2c25a23826ff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_75bcdb116b2724f67bc5f6701b64ff9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_2dd1d524992f1983df406cf0bb8d3892.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_a72a5d7761b4f7597197e95d2e54f1ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_9d5ba0d01c508c2a7deeb38b7f6953f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_7aa37fd12c11b6cb68012a8d3b738b71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_05c69bcce00e7bce9297978944a081f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_97e0170653f14bd8a076b1b58270ca4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89464f-51ba-5bbd-aea5-c2bcffefbc2c/9a89464f-51ba-5bbd-aea5-c2bcffefbc2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/b4/c4b40e2a92aaad710da99e6b1cea28de/pa/ES44185_919b2dd8aa28df21e70e4e84d4c96b32.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-08-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid R Design AWD',
'transmission': 'automatic',
'trim': 'R Design AWD',
'year': 2020}
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44185%27 HTTP/1.1" 200 None
2026-03-30 12:17:07 [auto1.it] INFO: Saving data for ES44185: {'created_time': 1774873027.190453, 'last_price_update_time': 1774873027.190468, 'auction_closing_time': 1774970931.0}
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES44185') HTTP/1.1" 204 0
2026-03-30 12:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ29938> (referer: https://www.auto1.com/v1/car-details-view/GZ29938/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ffd2916-8b21-5dac-bd42-899aa50c386c with identifier: GZ29938
2026-03-30 12:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ffd2916-8b21-5dac-bd42-899aa50c386c with scrape type 1
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_44d2e3ba81339f83db62714a38b67077.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_44d2e3ba81339f83db62714a38b67077.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_eba7bda2021fea39f0531b9b273f4547.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_eba7bda2021fea39f0531b9b273f4547.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_7d132445e32901a570b12127d89ba928.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_7d132445e32901a570b12127d89ba928.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_fee024524b6a1734d8778944bd416ee9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_fee024524b6a1734d8778944bd416ee9.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_745f4dd986f8db0062f702b333a5e896.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_745f4dd986f8db0062f702b333a5e896.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg not downloaded yet
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg not downloaded yet
2026-03-30 12:17:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW02999> (referer: https://www.auto1.com/v1/car-details-view/PW02999/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a475cab7-7c91-57c5-9e2f-c46c4543287a with identifier: PW02999
2026-03-30 12:17:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a475cab7-7c91-57c5-9e2f-c46c4543287a with scrape type 1
2026-03-30 12:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a475cab7-7c91-57c5-9e2f-c46c4543287a
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F31%252Fdc31c79cb671cc97f4cf78fae62894cb%252Fpa%252FPW02999_37cd155f2a541abcacd5c89baa01fa60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_37cd155f2a541abcacd5c89baa01fa60.jpg already downloaded
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F31%252Fdc31c79cb671cc97f4cf78fae62894cb%252Fpa%252FPW02999_2df85b8992d8a6d0e274f75bdd1f346b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_2df85b8992d8a6d0e274f75bdd1f346b.jpg already downloaded
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F31%252Fdc31c79cb671cc97f4cf78fae62894cb%252Fpa%252FPW02999_29e1d26eb4fd9884f68c54d83f15f11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_29e1d26eb4fd9884f68c54d83f15f11d.jpg already downloaded
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F31%252Fdc31c79cb671cc97f4cf78fae62894cb%252Fpa%252FPW02999_de285c8a39e65cb764b4ed0c0784aff6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_de285c8a39e65cb764b4ed0c0784aff6.jpg already downloaded
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F31%252Fdc31c79cb671cc97f4cf78fae62894cb%252Fpa%252FPW02999_6e7d71c661e782184c42e60d1cbe4fb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_6e7d71c661e782184c42e60d1cbe4fb2.jpg already downloaded
2026-03-30 12:17:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a475cab7-7c91-57c5-9e2f-c46c4543287a, identifier: PW02999
2026-03-30 12:17:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a475cab7-7c91-57c5-9e2f-c46c4543287a with identifier: PW02999
2026-03-30 12:17:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a475cab7-7c91-57c5-9e2f-c46c4543287a with identifier: PW02999
2026-03-30 12:17:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a475cab7-7c91-57c5-9e2f-c46c4543287a with identifier: PW02999 to the API
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PW02999>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:07:39Z',
'fuel_type': 'diesel',
'id': 'a475cab7-7c91-57c5-9e2f-c46c4543287a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW02999',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Ford',
'model': 'S-Max',
'odometer': 243181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_37cd155f2a541abcacd5c89baa01fa60.jpg',
'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_2df85b8992d8a6d0e274f75bdd1f346b.jpg',
'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_29e1d26eb4fd9884f68c54d83f15f11d.jpg',
'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_de285c8a39e65cb764b4ed0c0784aff6.jpg',
'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_6e7d71c661e782184c42e60d1cbe4fb2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a475cab7-7c91-57c5-9e2f-c46c4543287a/a475cab7-7c91-57c5-9e2f-c46c4543287a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_37cd155f2a541abcacd5c89baa01fa60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a475cab7-7c91-57c5-9e2f-c46c4543287a/a475cab7-7c91-57c5-9e2f-c46c4543287a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_2df85b8992d8a6d0e274f75bdd1f346b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a475cab7-7c91-57c5-9e2f-c46c4543287a/a475cab7-7c91-57c5-9e2f-c46c4543287a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_29e1d26eb4fd9884f68c54d83f15f11d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a475cab7-7c91-57c5-9e2f-c46c4543287a/a475cab7-7c91-57c5-9e2f-c46c4543287a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_de285c8a39e65cb764b4ed0c0784aff6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a475cab7-7c91-57c5-9e2f-c46c4543287a/a475cab7-7c91-57c5-9e2f-c46c4543287a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/31/dc31c79cb671cc97f4cf78fae62894cb/pa/PW02999_6e7d71c661e782184c42e60d1cbe4fb2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-11-20',
'seats_number': 7,
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2007}
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW02999%27 HTTP/1.1" 200 None
2026-03-30 12:17:28 [auto1.it] INFO: Saving data for PW02999: {'created_time': 1774873048.448818, 'last_price_update_time': 1774873048.448829, 'auction_closing_time': 1774969659.0}
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW02999') HTTP/1.1" 204 0
2026-03-30 12:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012affc10>
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg saved to cache
2026-03-30 12:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010917210>
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg saved to cache
2026-03-30 12:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_745f4dd986f8db0062f702b333a5e896.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff5b10>
2026-03-30 12:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_745f4dd986f8db0062f702b333a5e896.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_745f4dd986f8db0062f702b333a5e896.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fdce90>
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff5e10>
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_fee024524b6a1734d8778944bd416ee9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601093ad10>
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_fee024524b6a1734d8778944bd416ee9.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_fee024524b6a1734d8778944bd416ee9.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_7d132445e32901a570b12127d89ba928.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff7890>
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_7d132445e32901a570b12127d89ba928.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_7d132445e32901a570b12127d89ba928.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a84cd0>
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg saved to cache
2026-03-30 12:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_eba7bda2021fea39f0531b9b273f4547.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_44d2e3ba81339f83db62714a38b67077.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fe27d0>
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_eba7bda2021fea39f0531b9b273f4547.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_eba7bda2021fea39f0531b9b273f4547.jpg saved to cache
2026-03-30 12:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a56410>
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F2f%252Faa2f638dd5bfadb45663fd32cf7150d8%252Fpa%252FGZ29938_44d2e3ba81339f83db62714a38b67077.jpg') HTTP/1.1" 204 0
2026-03-30 12:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_44d2e3ba81339f83db62714a38b67077.jpg saved to cache
2026-03-30 12:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ffd2916-8b21-5dac-bd42-899aa50c386c
2026-03-30 12:17:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ffd2916-8b21-5dac-bd42-899aa50c386c, skipping ID generation
2026-03-30 12:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ffd2916-8b21-5dac-bd42-899aa50c386c with scrape type 1
2026-03-30 12:17:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ffd2916-8b21-5dac-bd42-899aa50c386c sending to next pipeline
2026-03-30 12:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7ffd2916-8b21-5dac-bd42-899aa50c386c, identifier: GZ29938
2026-03-30 12:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7ffd2916-8b21-5dac-bd42-899aa50c386c with identifier: GZ29938
2026-03-30 12:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7ffd2916-8b21-5dac-bd42-899aa50c386c with identifier: GZ29938
2026-03-30 12:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7ffd2916-8b21-5dac-bd42-899aa50c386c with identifier: GZ29938 to the API
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_44d2e3ba81339f83db62714a38b67077.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:39:49Z',
'fuel_type': 'petrol',
'id': '7ffd2916-8b21-5dac-bd42-899aa50c386c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ29938',
'listing': 'auction',
'location': 'IT, Busto Arsizio (VA)',
'make': 'Fiat',
'model': 'Panda',
'odometer': 136955,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_44d2e3ba81339f83db62714a38b67077.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_eba7bda2021fea39f0531b9b273f4547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_e2aad97e5e5dd7e89caa7e163a73e2d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_7d132445e32901a570b12127d89ba928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_fee024524b6a1734d8778944bd416ee9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_4b70185e01fd09d64ca7aab07527e9fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_5bc3e33355d8b2851216ce84ef8a31cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_745f4dd986f8db0062f702b333a5e896.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_03bfa5bb86d9521e462a9e720adb8b60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ffd2916-8b21-5dac-bd42-899aa50c386c/7ffd2916-8b21-5dac-bd42-899aa50c386c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/2f/aa2f638dd5bfadb45663fd32cf7150d8/pa/GZ29938_603ef1cd677d0d080e5b90901e7780b9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2017}
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29938%27 HTTP/1.1" 200 None
2026-03-30 12:17:30 [auto1.it] INFO: Saving data for GZ29938: {'created_time': 1774873050.599527, 'last_price_update_time': 1774873050.599538, 'auction_closing_time': 1774971589.0}
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ29938') HTTP/1.1" 204 0
2026-03-30 12:17:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE29361> (referer: https://www.auto1.com/v1/car-details-view/FE29361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5bb2a7d-07c2-5114-88b7-d71bc06c63d0 with identifier: FE29361
2026-03-30 12:17:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5bb2a7d-07c2-5114-88b7-d71bc06c63d0 with scrape type 1
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5bb2a7d-07c2-5114-88b7-d71bc06c63d0
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_1080d2b4b36c53a33853f13ecb078466.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_1080d2b4b36c53a33853f13ecb078466.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_9bc9e92d82013e0b521caa27728908d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_9bc9e92d82013e0b521caa27728908d7.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_6b923ccd62dcb40f88cdaf52563461cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6b923ccd62dcb40f88cdaf52563461cb.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_a0504cd9f7a1ded0ec9cffa711701a68.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a0504cd9f7a1ded0ec9cffa711701a68.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_a303eb09d75d6bcd78106cdb077168cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a303eb09d75d6bcd78106cdb077168cf.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_238eaeee0eff40832573af53419a0adf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_238eaeee0eff40832573af53419a0adf.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_6383a4da863acd9f64a3bd5700645608.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6383a4da863acd9f64a3bd5700645608.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_bc784804cdfde820aa6e38e25ca68052.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_bc784804cdfde820aa6e38e25ca68052.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_b352e6a5893a8d6ba866d83ab5335f62.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_b352e6a5893a8d6ba866d83ab5335f62.jpg already downloaded
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2e%252Fdb2e00c3088fedf13a0e53c6a3db8bcc%252Fpa%252FFE29361_78d6392b5657586a642db36da65a2a85.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_78d6392b5657586a642db36da65a2a85.jpg already downloaded
2026-03-30 12:17:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5bb2a7d-07c2-5114-88b7-d71bc06c63d0, identifier: FE29361
2026-03-30 12:17:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5bb2a7d-07c2-5114-88b7-d71bc06c63d0 with identifier: FE29361
2026-03-30 12:17:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5bb2a7d-07c2-5114-88b7-d71bc06c63d0 with identifier: FE29361
2026-03-30 12:17:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5bb2a7d-07c2-5114-88b7-d71bc06c63d0 with identifier: FE29361 to the API
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:17:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FE29361>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:28:02Z',
'fuel_type': 'diesel',
'id': 'c5bb2a7d-07c2-5114-88b7-d71bc06c63d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE29361',
'listing': 'auction',
'location': 'IT',
'make': 'BMW',
'model': 'X2',
'odometer': 52982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_1080d2b4b36c53a33853f13ecb078466.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_9bc9e92d82013e0b521caa27728908d7.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6b923ccd62dcb40f88cdaf52563461cb.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a0504cd9f7a1ded0ec9cffa711701a68.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a303eb09d75d6bcd78106cdb077168cf.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_238eaeee0eff40832573af53419a0adf.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6383a4da863acd9f64a3bd5700645608.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_bc784804cdfde820aa6e38e25ca68052.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_b352e6a5893a8d6ba866d83ab5335f62.jpg',
'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_78d6392b5657586a642db36da65a2a85.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_1080d2b4b36c53a33853f13ecb078466.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_9bc9e92d82013e0b521caa27728908d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6b923ccd62dcb40f88cdaf52563461cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a0504cd9f7a1ded0ec9cffa711701a68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_a303eb09d75d6bcd78106cdb077168cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_238eaeee0eff40832573af53419a0adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_6383a4da863acd9f64a3bd5700645608.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_bc784804cdfde820aa6e38e25ca68052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_b352e6a5893a8d6ba866d83ab5335f62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5bb2a7d-07c2-5114-88b7-d71bc06c63d0/c5bb2a7d-07c2-5114-88b7-d71bc06c63d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2e/db2e00c3088fedf13a0e53c6a3db8bcc/pa/FE29361_78d6392b5657586a642db36da65a2a85.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X2 sDrive 16d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2023}
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE29361%27 HTTP/1.1" 200 None
2026-03-30 12:17:42 [auto1.it] INFO: Saving data for FE29361: {'created_time': 1774873062.319766, 'last_price_update_time': 1774873062.319782, 'auction_closing_time': 1774970882.0}
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FE29361') HTTP/1.1" 204 0
2026-03-30 12:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH07036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM89065> (referer: https://www.auto1.com/v1/car-details-view/NM89065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:17:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:17:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with identifier: NM89065
2026-03-30 12:17:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with scrape type 1
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_76d755af702eb31e57af4fefaaa34541.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_76d755af702eb31e57af4fefaaa34541.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_3e90dabcc356f89aa2429c686228d548.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_3e90dabcc356f89aa2429c686228d548.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_80bd1c99e028513e46c6e79a2518240c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_80bd1c99e028513e46c6e79a2518240c.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_564dca2e47cfe90802671e2aa359f85a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_564dca2e47cfe90802671e2aa359f85a.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_aa5059b9ce74283146c775faa30fe3fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_aa5059b9ce74283146c775faa30fe3fd.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg not downloaded yet
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_1f90007cf49258faa9f2a67275437995.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_1f90007cf49258faa9f2a67275437995.jpg not downloaded yet
2026-03-30 12:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK61043> (referer: https://www.auto1.com/v1/car-details-view/PK61043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b16e708-91da-50f3-a47c-9ca3f643688f with identifier: PK61043
2026-03-30 12:18:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b16e708-91da-50f3-a47c-9ca3f643688f with scrape type 1
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_8f44d1fd23a03858f6646d3bf801341f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8f44d1fd23a03858f6646d3bf801341f.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_85146aea59074ad183c14a19f30ae7f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_85146aea59074ad183c14a19f30ae7f0.jpg not downloaded yet
2026-03-30 12:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_1f90007cf49258faa9f2a67275437995.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_17f22cb9c39c930b716db6eec41c67f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_17f22cb9c39c930b716db6eec41c67f3.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_399498d78246c74eed78a0b84111dfaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_399498d78246c74eed78a0b84111dfaa.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_a1acef6a565b81cf32da6413162d8568.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_a1acef6a565b81cf32da6413162d8568.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_1dd738d482d67bea14907ab870dd107a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_1dd738d482d67bea14907ab870dd107a.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_f1cf2586a928ee364527899c0616cbff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_f1cf2586a928ee364527899c0616cbff.jpg not downloaded yet
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg not downloaded yet
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff6c10>
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_1f90007cf49258faa9f2a67275437995.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_1f90007cf49258faa9f2a67275437995.jpg saved to cache
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_85146aea59074ad183c14a19f30ae7f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb5bd0>
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_85146aea59074ad183c14a19f30ae7f0.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_85146aea59074ad183c14a19f30ae7f0.jpg saved to cache
2026-03-30 12:18:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6d410>
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg saved to cache
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_f1cf2586a928ee364527899c0616cbff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb7090>
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_f1cf2586a928ee364527899c0616cbff.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_f1cf2586a928ee364527899c0616cbff.jpg saved to cache
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_1dd738d482d67bea14907ab870dd107a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a257d0>
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_1dd738d482d67bea14907ab870dd107a.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_1dd738d482d67bea14907ab870dd107a.jpg saved to cache
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_a1acef6a565b81cf32da6413162d8568.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091fe50>
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_a1acef6a565b81cf32da6413162d8568.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_a1acef6a565b81cf32da6413162d8568.jpg saved to cache
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_399498d78246c74eed78a0b84111dfaa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108ca990>
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_399498d78246c74eed78a0b84111dfaa.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_399498d78246c74eed78a0b84111dfaa.jpg saved to cache
2026-03-30 12:18:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_17f22cb9c39c930b716db6eec41c67f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091d290>
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_17f22cb9c39c930b716db6eec41c67f3.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_17f22cb9c39c930b716db6eec41c67f3.jpg saved to cache
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:04 [scrapy.extensions.logstats] INFO: Crawled 66 pages (at 11 pages/min), scraped 44 items (at 4 items/min)
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091c590>
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg saved to cache
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8f44d1fd23a03858f6646d3bf801341f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff5490>
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg saved to cache
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010935b90>
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F35%252Fcd35aa6fc7c58d491a193df50c5eeb36%252Fpa%252FPK61043_8f44d1fd23a03858f6646d3bf801341f.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8f44d1fd23a03858f6646d3bf801341f.jpg saved to cache
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b16e708-91da-50f3-a47c-9ca3f643688f
2026-03-30 12:18:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b16e708-91da-50f3-a47c-9ca3f643688f, skipping ID generation
2026-03-30 12:18:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b16e708-91da-50f3-a47c-9ca3f643688f with scrape type 1
2026-03-30 12:18:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b16e708-91da-50f3-a47c-9ca3f643688f sending to next pipeline
2026-03-30 12:18:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b16e708-91da-50f3-a47c-9ca3f643688f, identifier: PK61043
2026-03-30 12:18:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b16e708-91da-50f3-a47c-9ca3f643688f with identifier: PK61043
2026-03-30 12:18:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b16e708-91da-50f3-a47c-9ca3f643688f with identifier: PK61043
2026-03-30 12:18:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b16e708-91da-50f3-a47c-9ca3f643688f with identifier: PK61043 to the API
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:18:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8f44d1fd23a03858f6646d3bf801341f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:09:35Z',
'fuel_type': 'diesel',
'id': '3b16e708-91da-50f3-a47c-9ca3f643688f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK61043',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Audi',
'model': 'Q3',
'odometer': 314876,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8f44d1fd23a03858f6646d3bf801341f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_6def58e44babd8f76e803e56c2d5ed6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_85146aea59074ad183c14a19f30ae7f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_8bafab5c7779fbe1b5da3d10be1f8b1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_17f22cb9c39c930b716db6eec41c67f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_399498d78246c74eed78a0b84111dfaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_a1acef6a565b81cf32da6413162d8568.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_1dd738d482d67bea14907ab870dd107a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_f1cf2586a928ee364527899c0616cbff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b16e708-91da-50f3-a47c-9ca3f643688f/3b16e708-91da-50f3-a47c-9ca3f643688f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/35/cd35aa6fc7c58d491a193df50c5eeb36/pa/PK61043_e758f3979f9df63ad967be14a2fe1d1b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Business',
'transmission': 'automatic',
'trim': 'quattro Business',
'year': 2016}
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK61043%27 HTTP/1.1" 200 None
2026-03-30 12:18:04 [auto1.it] INFO: Saving data for PK61043: {'created_time': 1774873084.947375, 'last_price_update_time': 1774873084.947386, 'auction_closing_time': 1774969775.0}
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK61043') HTTP/1.1" 204 0
2026-03-30 12:18:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f9bf50>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc7dd0>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_aa5059b9ce74283146c775faa30fe3fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108c9a90>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_aa5059b9ce74283146c775faa30fe3fd.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_aa5059b9ce74283146c775faa30fe3fd.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_564dca2e47cfe90802671e2aa359f85a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc4e50>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_564dca2e47cfe90802671e2aa359f85a.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_564dca2e47cfe90802671e2aa359f85a.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_80bd1c99e028513e46c6e79a2518240c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60128837d0>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_80bd1c99e028513e46c6e79a2518240c.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_80bd1c99e028513e46c6e79a2518240c.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_3e90dabcc356f89aa2429c686228d548.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a347d0>
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_3e90dabcc356f89aa2429c686228d548.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_3e90dabcc356f89aa2429c686228d548.jpg saved to cache
2026-03-30 12:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108c8a50>
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg saved to cache
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_76d755af702eb31e57af4fefaaa34541.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb74d0>
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_76d755af702eb31e57af4fefaaa34541.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_76d755af702eb31e57af4fefaaa34541.jpg saved to cache
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f1f750>
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F06%252F1206efa5a0002c0b274e2c34d5b35298%252Fpa%252FNM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg saved to cache
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc
2026-03-30 12:18:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc, skipping ID generation
2026-03-30 12:18:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with scrape type 1
2026-03-30 12:18:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae42c95f-5b7a-5a28-8949-7f7ae36f69fc sending to next pipeline
2026-03-30 12:18:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc, identifier: NM89065
2026-03-30 12:18:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with identifier: NM89065
2026-03-30 12:18:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with identifier: NM89065
2026-03-30 12:18:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae42c95f-5b7a-5a28-8949-7f7ae36f69fc with identifier: NM89065 to the API
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:18:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 93,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:23:07Z',
'fuel_type': 'petrol',
'id': 'ae42c95f-5b7a-5a28-8949-7f7ae36f69fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM89065',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Opel',
'model': 'Corsa',
'odometer': 118028,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37269,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_8d05df20cc8038dcec931e47e65eaf8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37269,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_76d755af702eb31e57af4fefaaa34541.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36103,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_4d66c41c22e44cc5cc2260bdbb6f283c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34628,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_3e90dabcc356f89aa2429c686228d548.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30333,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_80bd1c99e028513e46c6e79a2518240c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35982,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_564dca2e47cfe90802671e2aa359f85a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33931,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_aa5059b9ce74283146c775faa30fe3fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37444,
'Height': 530,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_7a209a3f588b45bd5abe9963fadc4eb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31852,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_2f036bcd1ac705a291814d9a00a48f6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae42c95f-5b7a-5a28-8949-7f7ae36f69fc/ae42c95f-5b7a-5a28-8949-7f7ae36f69fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22276,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img12/06/1206efa5a0002c0b274e2c34d5b35298/pa/NM89065_1f90007cf49258faa9f2a67275437995.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2020}
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM89065%27 HTTP/1.1" 200 None
2026-03-30 12:18:06 [auto1.it] INFO: Saving data for NM89065: {'created_time': 1774873086.832182, 'last_price_update_time': 1774873086.832195, 'auction_closing_time': 1774970587.0}
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NM89065') HTTP/1.1" 204 0
2026-03-30 12:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB45776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:36 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3577 | hits on page: 40
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: ZJ84869
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: UJ09788
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: NS08410
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: MR48932
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: LT27562
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: EU42930
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: AU36225
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU36225%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for AU36225: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: PD19752
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD19752%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for PD19752: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: NS36184
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: JG99232
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG99232%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for JG99232: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: WS34507
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS34507%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for WS34507: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: AW90705
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: UD98001
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: JW36955
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW36955%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for JW36955: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: BH63969
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: VY03652
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY03652%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for VY03652: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: RF51133
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF51133%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for RF51133: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: KJ21234
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: TS38053
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: VF71382
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: LW91242
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW91242%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for LW91242: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: VF70774
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF70774%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for VF70774: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: SM07147
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM07147%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for SM07147: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: NP04609
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: FU07793
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU07793%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for FU07793: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: DL76635
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL76635%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for DL76635: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: TF45632
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: NG60482
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG60482%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for NG60482: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: NG00977
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG00977%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for NG00977: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: XC99341
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: TX14576
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX14576%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for TX14576: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: EC17055
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC17055%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for EC17055: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: GV61096
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV61096%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for GV61096: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: MD92302
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: JB82586
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB82586%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for JB82586: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: EK06543
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: DR88272
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR88272%27 HTTP/1.1" 200 None
2026-03-30 12:18:36 [auto1.it] INFO: Scrape type for DR88272: 1
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: XU36163
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: TW74666
2026-03-30 12:18:36 [auto1.it] INFO: Found listing with ID: UE40276
2026-03-30 12:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT64960> (referer: https://www.auto1.com/v1/car-details-view/ZT64960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:18:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:18:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd7f5c18-5bbe-5328-a405-84d0ab58f42c with identifier: ZT64960
2026-03-30 12:18:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd7f5c18-5bbe-5328-a405-84d0ab58f42c with scrape type 1
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bd7f5c18-5bbe-5328-a405-84d0ab58f42c
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_f1f8cc479eb7cd4104e2a3e0b76e49c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_f1f8cc479eb7cd4104e2a3e0b76e49c1.jpg already downloaded
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_45fa4d84d9bbc6af912a44e757a2612a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_45fa4d84d9bbc6af912a44e757a2612a.jpg already downloaded
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_e22447dc58374f4d624948ccee0409c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_e22447dc58374f4d624948ccee0409c3.jpg already downloaded
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_1c5c2debc44478a6165170964cceaba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1c5c2debc44478a6165170964cceaba0.jpg already downloaded
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_1799886957b43a54f2ea93714a9b1dec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1799886957b43a54f2ea93714a9b1dec.jpg already downloaded
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F08%252F4108a80e8d38e0918ee2ee7257c9d2ad%252Fpa%252FZT64960_49657d534c7a204b0e7cdcfc0da0e683.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_49657d534c7a204b0e7cdcfc0da0e683.jpg already downloaded
2026-03-30 12:18:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd7f5c18-5bbe-5328-a405-84d0ab58f42c, identifier: ZT64960
2026-03-30 12:18:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd7f5c18-5bbe-5328-a405-84d0ab58f42c with identifier: ZT64960
2026-03-30 12:18:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd7f5c18-5bbe-5328-a405-84d0ab58f42c with identifier: ZT64960
2026-03-30 12:18:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd7f5c18-5bbe-5328-a405-84d0ab58f42c with identifier: ZT64960 to the API
2026-03-30 12:18:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:18:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:18:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZT64960>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:31:09Z',
'fuel_type': 'petrol',
'id': 'bd7f5c18-5bbe-5328-a405-84d0ab58f42c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT64960',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Fiat',
'model': 'Punto',
'odometer': 164478,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_f1f8cc479eb7cd4104e2a3e0b76e49c1.jpg',
'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_45fa4d84d9bbc6af912a44e757a2612a.jpg',
'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_e22447dc58374f4d624948ccee0409c3.jpg',
'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1c5c2debc44478a6165170964cceaba0.jpg',
'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1799886957b43a54f2ea93714a9b1dec.jpg',
'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_49657d534c7a204b0e7cdcfc0da0e683.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_f1f8cc479eb7cd4104e2a3e0b76e49c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_45fa4d84d9bbc6af912a44e757a2612a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_e22447dc58374f4d624948ccee0409c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1c5c2debc44478a6165170964cceaba0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_1799886957b43a54f2ea93714a9b1dec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7f5c18-5bbe-5328-a405-84d0ab58f42c/bd7f5c18-5bbe-5328-a405-84d0ab58f42c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/08/4108a80e8d38e0918ee2ee7257c9d2ad/pa/ZT64960_49657d534c7a204b0e7cdcfc0da0e683.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.4 Street',
'transmission': 'manual',
'trim': 'Street',
'year': 2014}
2026-03-30 12:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT64960%27 HTTP/1.1" 200 None
2026-03-30 12:18:41 [auto1.it] INFO: Saving data for ZT64960: {'created_time': 1774873121.164781, 'last_price_update_time': 1774873121.164793, 'auction_closing_time': 1774971069.0}
2026-03-30 12:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT64960') HTTP/1.1" 204 0
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.397(s), this was the 1st time calling it.
2026-03-30 12:18:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.995458317689687 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.174(s), this was the 1st time calling it.
2026-03-30 12:19:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.371648864337423 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:04 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 2 pages/min), scraped 47 items (at 3 items/min)
2026-03-30 12:19:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.377(s), this was the 2nd time calling it.
2026-03-30 12:19:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.761521272846338 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:19:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.967(s), this was the 1st time calling it.
2026-03-30 12:19:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.621524221295923 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:19:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH00208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY61336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU33475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC69599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH07036> (referer: https://www.auto1.com/v1/car-details-view/DH07036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:19:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:19:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1cc46f-0ec8-583f-8182-519d9a45590d with identifier: DH07036
2026-03-30 12:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1cc46f-0ec8-583f-8182-519d9a45590d with scrape type 1
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f1cc46f-0ec8-583f-8182-519d9a45590d
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_b7a7ea57329533e0e76260909f8ed4c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_b7a7ea57329533e0e76260909f8ed4c6.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_71fb7fe6bd2c1cbe11aa6e568657a0c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_71fb7fe6bd2c1cbe11aa6e568657a0c2.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_f3cdbfddbe231a07e18dab4c1b795396.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_f3cdbfddbe231a07e18dab4c1b795396.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_abe101c848b1a4448687ae71cf7a0833.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_abe101c848b1a4448687ae71cf7a0833.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_871ecf62bf6cd659318afd267789c9d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_871ecf62bf6cd659318afd267789c9d8.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_00a688cd2adc66490b8d0cf8a1655a4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_00a688cd2adc66490b8d0cf8a1655a4d.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_c4556a924ee1f387fc63431a6af4a5de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_c4556a924ee1f387fc63431a6af4a5de.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_860b67c95827e00b31d2a91feb6d914c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_860b67c95827e00b31d2a91feb6d914c.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_e2a848f870e575e92c71df844db69cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_e2a848f870e575e92c71df844db69cd5.jpg already downloaded
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F447317e88779349ee7b2c01a5b604a45%252Fpa%252FDH07036_10d9a51cd26389e3ab63a687b4b736ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_10d9a51cd26389e3ab63a687b4b736ed.jpg already downloaded
2026-03-30 12:19:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f1cc46f-0ec8-583f-8182-519d9a45590d, identifier: DH07036
2026-03-30 12:19:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f1cc46f-0ec8-583f-8182-519d9a45590d with identifier: DH07036
2026-03-30 12:19:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f1cc46f-0ec8-583f-8182-519d9a45590d with identifier: DH07036
2026-03-30 12:19:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f1cc46f-0ec8-583f-8182-519d9a45590d with identifier: DH07036 to the API
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DH07036>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:46:18Z',
'fuel_type': 'diesel',
'id': '3f1cc46f-0ec8-583f-8182-519d9a45590d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH07036',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'BMW',
'model': 'X3',
'odometer': 253757,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_b7a7ea57329533e0e76260909f8ed4c6.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_71fb7fe6bd2c1cbe11aa6e568657a0c2.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_f3cdbfddbe231a07e18dab4c1b795396.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_abe101c848b1a4448687ae71cf7a0833.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_871ecf62bf6cd659318afd267789c9d8.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_00a688cd2adc66490b8d0cf8a1655a4d.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_c4556a924ee1f387fc63431a6af4a5de.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_860b67c95827e00b31d2a91feb6d914c.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_e2a848f870e575e92c71df844db69cd5.jpg',
'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_10d9a51cd26389e3ab63a687b4b736ed.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2679951,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_b7a7ea57329533e0e76260909f8ed4c6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2630107,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_71fb7fe6bd2c1cbe11aa6e568657a0c2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2661942,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_f3cdbfddbe231a07e18dab4c1b795396.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2413415,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_abe101c848b1a4448687ae71cf7a0833.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557447,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_871ecf62bf6cd659318afd267789c9d8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_00a688cd2adc66490b8d0cf8a1655a4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938745,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_c4556a924ee1f387fc63431a6af4a5de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_860b67c95827e00b31d2a91feb6d914c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_e2a848f870e575e92c71df844db69cd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1cc46f-0ec8-583f-8182-519d9a45590d/3f1cc46f-0ec8-583f-8182-519d9a45590d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3169128,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/447317e88779349ee7b2c01a5b604a45/pa/DH07036_10d9a51cd26389e3ab63a687b4b736ed.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH07036%27 HTTP/1.1" 200 None
2026-03-30 12:19:56 [auto1.it] INFO: Saving data for DH07036: {'created_time': 1774873196.960475, 'last_price_update_time': 1774873196.960486, 'auction_closing_time': 1774971978.0}
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DH07036') HTTP/1.1" 204 0
2026-03-30 12:19:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.799(s), this was the 1st time calling it.
2026-03-30 12:19:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.257755252192776 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR89969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:04 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 6 pages/min), scraped 48 items (at 1 items/min)
2026-03-30 12:20:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-30 12:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF40578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:20:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS08410> (referer: https://www.auto1.com/v1/car-details-view/NS08410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with identifier: NS08410
2026-03-30 12:20:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with scrape type 1
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_7a84291a7f006570266d464a7cd4cc49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_7a84291a7f006570266d464a7cd4cc49.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_4b2a73a7da816d17d5f143d25c81282c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_4b2a73a7da816d17d5f143d25c81282c.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_edd903e92981b984ad3db26121327215.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_edd903e92981b984ad3db26121327215.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_bd54ff33188ff5eb790909995b204590.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_bd54ff33188ff5eb790909995b204590.jpg not downloaded yet
2026-03-30 12:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_33a1ee519e3c2357aab376942c0b292b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_33a1ee519e3c2357aab376942c0b292b.jpg not downloaded yet
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg not downloaded yet
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_6e9e04182495c794069984acbd21b840.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_6e9e04182495c794069984acbd21b840.jpg not downloaded yet
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg not downloaded yet
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg not downloaded yet
2026-03-30 12:20:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.060(s), this was the 1st time calling it.
2026-03-30 12:20:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.606575217645872 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM48251> (referer: https://www.auto1.com/v1/car-details-view/VM48251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a744aa3-bb92-526b-9110-1518e607d792 with identifier: VM48251
2026-03-30 12:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a744aa3-bb92-526b-9110-1518e607d792 with scrape type 1
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a744aa3-bb92-526b-9110-1518e607d792
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_4e625091efb9599b8177c973e3ecada7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_4e625091efb9599b8177c973e3ecada7.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_e69c3aa29476ee7ba0840f3f5da72994.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_e69c3aa29476ee7ba0840f3f5da72994.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_b5866e162cda29d932142b373b713ee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_b5866e162cda29d932142b373b713ee0.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_980125237279c98f77d5445fe53aa5ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_980125237279c98f77d5445fe53aa5ad.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_661d3891f5c078f55b66270c8ec9f789.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_661d3891f5c078f55b66270c8ec9f789.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_5eaac5289b6f40a9f3d9d566ba35c085.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_5eaac5289b6f40a9f3d9d566ba35c085.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_cbdeadab0d1d03b28a63978c751b1ba5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_cbdeadab0d1d03b28a63978c751b1ba5.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_c65b418bbb70bb3aa883b39e9600c463.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c65b418bbb70bb3aa883b39e9600c463.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_c8231a3abd8a378e6df1217344a9d268.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c8231a3abd8a378e6df1217344a9d268.jpg already downloaded
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F97%252F7e97cba825af0b8c3f48bcc6a4d6202d%252Fpa%252FVM48251_14c7e1b8524475bbd2c75107546024af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_14c7e1b8524475bbd2c75107546024af.jpg already downloaded
2026-03-30 12:20:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a744aa3-bb92-526b-9110-1518e607d792, identifier: VM48251
2026-03-30 12:20:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a744aa3-bb92-526b-9110-1518e607d792 with identifier: VM48251
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 12:20:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:20:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a744aa3-bb92-526b-9110-1518e607d792 with identifier: VM48251
2026-03-30 12:20:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a744aa3-bb92-526b-9110-1518e607d792 with identifier: VM48251 to the API
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM48251>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:33:14Z',
'fuel_type': 'petrol',
'id': '1a744aa3-bb92-526b-9110-1518e607d792',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM48251',
'listing': 'auction',
'location': 'IT, Vercelli',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 126918,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_4e625091efb9599b8177c973e3ecada7.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_e69c3aa29476ee7ba0840f3f5da72994.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_b5866e162cda29d932142b373b713ee0.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_980125237279c98f77d5445fe53aa5ad.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_661d3891f5c078f55b66270c8ec9f789.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_5eaac5289b6f40a9f3d9d566ba35c085.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_cbdeadab0d1d03b28a63978c751b1ba5.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c65b418bbb70bb3aa883b39e9600c463.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c8231a3abd8a378e6df1217344a9d268.jpg',
'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_14c7e1b8524475bbd2c75107546024af.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_4e625091efb9599b8177c973e3ecada7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_e69c3aa29476ee7ba0840f3f5da72994.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_b5866e162cda29d932142b373b713ee0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_980125237279c98f77d5445fe53aa5ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_661d3891f5c078f55b66270c8ec9f789.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_5eaac5289b6f40a9f3d9d566ba35c085.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_cbdeadab0d1d03b28a63978c751b1ba5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c65b418bbb70bb3aa883b39e9600c463.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_c8231a3abd8a378e6df1217344a9d268.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a744aa3-bb92-526b-9110-1518e607d792/1a744aa3-bb92-526b-9110-1518e607d792_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7e/97/7e97cba825af0b8c3f48bcc6a4d6202d/pa/VM48251_14c7e1b8524475bbd2c75107546024af.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-03',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM48251%27 HTTP/1.1" 200 None
2026-03-30 12:20:29 [auto1.it] INFO: Saving data for VM48251: {'created_time': 1774873229.074242, 'last_price_update_time': 1774873229.074254, 'auction_closing_time': 1774971194.0}
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM48251') HTTP/1.1" 204 0
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.423(s), this was the 1st time calling it.
2026-03-30 12:20:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.472906231638702 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a34090>
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg saved to cache
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f9b450>
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg saved to cache
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_6e9e04182495c794069984acbd21b840.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3fbd0>
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_6e9e04182495c794069984acbd21b840.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_6e9e04182495c794069984acbd21b840.jpg saved to cache
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b02ed0>
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg saved to cache
2026-03-30 12:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_33a1ee519e3c2357aab376942c0b292b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fae010>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_33a1ee519e3c2357aab376942c0b292b.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_33a1ee519e3c2357aab376942c0b292b.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_bd54ff33188ff5eb790909995b204590.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB82586/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd5ed0>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_bd54ff33188ff5eb790909995b204590.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_bd54ff33188ff5eb790909995b204590.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_edd903e92981b984ad3db26121327215.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010908710>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_edd903e92981b984ad3db26121327215.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_edd903e92981b984ad3db26121327215.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_4b2a73a7da816d17d5f143d25c81282c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb7e10>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_4b2a73a7da816d17d5f143d25c81282c.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_4b2a73a7da816d17d5f143d25c81282c.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_7a84291a7f006570266d464a7cd4cc49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601286a550>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_7a84291a7f006570266d464a7cd4cc49.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_7a84291a7f006570266d464a7cd4cc49.jpg saved to cache
2026-03-30 12:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f87850>
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe9%252F9fe9be98b5ab42dd9bc1a1842110fc9b%252Fpa%252FNS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg saved to cache
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2
2026-03-30 12:20:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2, skipping ID generation
2026-03-30 12:20:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with scrape type 1
2026-03-30 12:20:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 sending to next pipeline
2026-03-30 12:20:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2, identifier: NS08410
2026-03-30 12:20:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with identifier: NS08410
2026-03-30 12:20:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with identifier: NS08410
2026-03-30 12:20:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c6e2cbec-c4e4-57ae-a08b-81ffac2284f2 with identifier: NS08410 to the API
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:34:01Z',
'fuel_type': 'petrol',
'id': 'c6e2cbec-c4e4-57ae-a08b-81ffac2284f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS08410',
'listing': 'auction',
'location': 'IT, Pompei',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 88066,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3126907,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_de4ec2fc877ebae550fb8c27fd2e17b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_7a84291a7f006570266d464a7cd4cc49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2872325,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_4b2a73a7da816d17d5f143d25c81282c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_edd903e92981b984ad3db26121327215.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_bd54ff33188ff5eb790909995b204590.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_33a1ee519e3c2357aab376942c0b292b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_b2872feb9e24474c7e513a9a6ebf3c23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_6e9e04182495c794069984acbd21b840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_88fc4d050cabc986b9c80ae3ae25450c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6e2cbec-c4e4-57ae-a08b-81ffac2284f2/c6e2cbec-c4e4-57ae-a08b-81ffac2284f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/e9/9fe9be98b5ab42dd9bc1a1842110fc9b/pa/NS08410_ffd6de4fe23ebab9be4f3bcb61c8ca99.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS08410%27 HTTP/1.1" 200 None
2026-03-30 12:20:31 [auto1.it] INFO: Saving data for NS08410: {'created_time': 1774873231.913747, 'last_price_update_time': 1774873231.913756, 'auction_closing_time': 1774971241.0}
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS08410') HTTP/1.1" 204 0
2026-03-30 12:20:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH00208> (referer: https://www.auto1.com/v1/car-details-view/AH00208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc14d3fb-3e31-5967-8c9b-417283e0e342 with identifier: AH00208
2026-03-30 12:20:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc14d3fb-3e31-5967-8c9b-417283e0e342 with scrape type 1
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item bc14d3fb-3e31-5967-8c9b-417283e0e342
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F38%252F5538e93d6ba8c58a0ebf28c9e5084fa9%252Fpa%252FAH00208_822dbd957ee0ca93090d4fca7f59b9c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_822dbd957ee0ca93090d4fca7f59b9c3.jpg already downloaded
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F38%252F5538e93d6ba8c58a0ebf28c9e5084fa9%252Fpa%252FAH00208_04b6717f3a90a3eab767d2d57ac3aad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_04b6717f3a90a3eab767d2d57ac3aad2.jpg already downloaded
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F38%252F5538e93d6ba8c58a0ebf28c9e5084fa9%252Fpa%252FAH00208_5de32f6e2c4cf4d27c3bfe002c575831.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_5de32f6e2c4cf4d27c3bfe002c575831.jpg already downloaded
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F38%252F5538e93d6ba8c58a0ebf28c9e5084fa9%252Fpa%252FAH00208_438278b7c3d990e60350ff6b33cae63d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_438278b7c3d990e60350ff6b33cae63d.jpg already downloaded
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252F38%252F5538e93d6ba8c58a0ebf28c9e5084fa9%252Fpa%252FAH00208_8db61dcb0cc6d9d5166d361672be1fe8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_8db61dcb0cc6d9d5166d361672be1fe8.jpg already downloaded
2026-03-30 12:20:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc14d3fb-3e31-5967-8c9b-417283e0e342, identifier: AH00208
2026-03-30 12:20:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc14d3fb-3e31-5967-8c9b-417283e0e342 with identifier: AH00208
2026-03-30 12:20:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc14d3fb-3e31-5967-8c9b-417283e0e342 with identifier: AH00208
2026-03-30 12:20:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc14d3fb-3e31-5967-8c9b-417283e0e342 with identifier: AH00208 to the API
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH00208>
{'auction_title': '',
'c_o_2_emission_value': 194,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:37:40Z',
'fuel_type': 'diesel',
'id': 'bc14d3fb-3e31-5967-8c9b-417283e0e342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH00208',
'listing': 'auction',
'location': 'IT, Sassari',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 310127,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_822dbd957ee0ca93090d4fca7f59b9c3.jpg',
'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_04b6717f3a90a3eab767d2d57ac3aad2.jpg',
'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_5de32f6e2c4cf4d27c3bfe002c575831.jpg',
'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_438278b7c3d990e60350ff6b33cae63d.jpg',
'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_8db61dcb0cc6d9d5166d361672be1fe8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc14d3fb-3e31-5967-8c9b-417283e0e342/bc14d3fb-3e31-5967-8c9b-417283e0e342_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_822dbd957ee0ca93090d4fca7f59b9c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc14d3fb-3e31-5967-8c9b-417283e0e342/bc14d3fb-3e31-5967-8c9b-417283e0e342_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_04b6717f3a90a3eab767d2d57ac3aad2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc14d3fb-3e31-5967-8c9b-417283e0e342/bc14d3fb-3e31-5967-8c9b-417283e0e342_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_5de32f6e2c4cf4d27c3bfe002c575831.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc14d3fb-3e31-5967-8c9b-417283e0e342/bc14d3fb-3e31-5967-8c9b-417283e0e342_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_438278b7c3d990e60350ff6b33cae63d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc14d3fb-3e31-5967-8c9b-417283e0e342/bc14d3fb-3e31-5967-8c9b-417283e0e342_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/38/5538e93d6ba8c58a0ebf28c9e5084fa9/pa/AH00208_8db61dcb0cc6d9d5166d361672be1fe8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 S',
'transmission': 'manual',
'trim': 'S',
'year': 2007}
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH00208%27 HTTP/1.1" 200 None
2026-03-30 12:20:32 [auto1.it] INFO: Saving data for AH00208: {'created_time': 1774873232.538397, 'last_price_update_time': 1774873232.538408, 'auction_closing_time': 1774971460.0}
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH00208') HTTP/1.1" 204 0
2026-03-30 12:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY61336> (referer: https://www.auto1.com/v1/car-details-view/YY61336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with identifier: YY61336
2026-03-30 12:20:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with scrape type 1
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_2452e37c357216672517c141e5ac2511.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_2452e37c357216672517c141e5ac2511.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_407823a63e69254725ea5040b15f1fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_407823a63e69254725ea5040b15f1fb7.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_59664ff966a03458430bf0e027254646.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_59664ff966a03458430bf0e027254646.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_c266f08c5e77240b5d80ffda06363560.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_c266f08c5e77240b5d80ffda06363560.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_b127ce83dd1a13f14e350719e4cf893e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_b127ce83dd1a13f14e350719e4cf893e.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_ec010d32357b60c982d4275deaaee9f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_ec010d32357b60c982d4275deaaee9f4.jpg not downloaded yet
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg not downloaded yet
2026-03-30 12:20:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU33475> (referer: https://www.auto1.com/v1/car-details-view/LU33475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c82eef6-14c5-5a96-b89a-46099c8c0ee3 with identifier: LU33475
2026-03-30 12:20:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c82eef6-14c5-5a96-b89a-46099c8c0ee3 with scrape type 1
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c82eef6-14c5-5a96-b89a-46099c8c0ee3
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_9eca7386b7a22e9ae2448003a09ed83f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_9eca7386b7a22e9ae2448003a09ed83f.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_abd3f2a533f75beafff401cb44b6099d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_abd3f2a533f75beafff401cb44b6099d.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_0f18cf13e4818edc75ad19f3acc50b5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_0f18cf13e4818edc75ad19f3acc50b5a.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_ee0d77363f2ed97b497a90f57b397c4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_ee0d77363f2ed97b497a90f57b397c4c.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_16897bb8d1d070d814419ecf7f279526.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_16897bb8d1d070d814419ecf7f279526.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_447007bcebe45b5b30f1129190d1200e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_447007bcebe45b5b30f1129190d1200e.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_67185cbba86cdc912cf7befec50d2829.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_67185cbba86cdc912cf7befec50d2829.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_4a353550ab8d3f7efeb8e7d65405fb00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_4a353550ab8d3f7efeb8e7d65405fb00.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_5df7ae02c709dfa8b4610058a1f68a55.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_5df7ae02c709dfa8b4610058a1f68a55.jpg already downloaded
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Ff9%252F44f96cbb50f04f98dfe764cb6a326542%252Fpa%252FLU33475_460c3cc81da589b457f95d840a6f2288.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_460c3cc81da589b457f95d840a6f2288.jpg already downloaded
2026-03-30 12:20:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c82eef6-14c5-5a96-b89a-46099c8c0ee3, identifier: LU33475
2026-03-30 12:20:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c82eef6-14c5-5a96-b89a-46099c8c0ee3 with identifier: LU33475
2026-03-30 12:20:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c82eef6-14c5-5a96-b89a-46099c8c0ee3 with identifier: LU33475
2026-03-30 12:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c82eef6-14c5-5a96-b89a-46099c8c0ee3 with identifier: LU33475 to the API
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU33475>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 310,
'expiration_date': '2026-03-31T15:51:17Z',
'fuel_type': 'petrol',
'id': '3c82eef6-14c5-5a96-b89a-46099c8c0ee3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU33475',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Audi',
'model': 'S3 Sportback',
'odometer': 150664,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_9eca7386b7a22e9ae2448003a09ed83f.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_abd3f2a533f75beafff401cb44b6099d.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_0f18cf13e4818edc75ad19f3acc50b5a.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_ee0d77363f2ed97b497a90f57b397c4c.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_16897bb8d1d070d814419ecf7f279526.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_447007bcebe45b5b30f1129190d1200e.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_67185cbba86cdc912cf7befec50d2829.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_4a353550ab8d3f7efeb8e7d65405fb00.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_5df7ae02c709dfa8b4610058a1f68a55.jpg',
'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_460c3cc81da589b457f95d840a6f2288.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_9eca7386b7a22e9ae2448003a09ed83f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2508631,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_abd3f2a533f75beafff401cb44b6099d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2541742,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_0f18cf13e4818edc75ad19f3acc50b5a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_ee0d77363f2ed97b497a90f57b397c4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2498987,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_16897bb8d1d070d814419ecf7f279526.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510984,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_447007bcebe45b5b30f1129190d1200e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2593327,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_67185cbba86cdc912cf7befec50d2829.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2570534,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_4a353550ab8d3f7efeb8e7d65405fb00.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_5df7ae02c709dfa8b4610058a1f68a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82eef6-14c5-5a96-b89a-46099c8c0ee3/3c82eef6-14c5-5a96-b89a-46099c8c0ee3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/f9/44f96cbb50f04f98dfe764cb6a326542/pa/LU33475_460c3cc81da589b457f95d840a6f2288.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi S3 Sportback 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU33475%27 HTTP/1.1" 200 None
2026-03-30 12:20:36 [auto1.it] INFO: Saving data for LU33475: {'created_time': 1774873236.808699, 'last_price_update_time': 1774873236.808714, 'auction_closing_time': 1774972277.0}
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU33475') HTTP/1.1" 204 0
2026-03-30 12:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_ec010d32357b60c982d4275deaaee9f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f9bb90>
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg saved to cache
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012881e10>
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_ec010d32357b60c982d4275deaaee9f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_ec010d32357b60c982d4275deaaee9f4.jpg saved to cache
2026-03-30 12:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_b127ce83dd1a13f14e350719e4cf893e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_c266f08c5e77240b5d80ffda06363560.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091f390>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_b127ce83dd1a13f14e350719e4cf893e.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_b127ce83dd1a13f14e350719e4cf893e.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a37d90>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60116d9010>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_c266f08c5e77240b5d80ffda06363560.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_c266f08c5e77240b5d80ffda06363560.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_59664ff966a03458430bf0e027254646.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f614d0>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_407823a63e69254725ea5040b15f1fb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fde8d0>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_59664ff966a03458430bf0e027254646.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_59664ff966a03458430bf0e027254646.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd5c10>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_2452e37c357216672517c141e5ac2511.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601090b810>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_407823a63e69254725ea5040b15f1fb7.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_407823a63e69254725ea5040b15f1fb7.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a34410>
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F33%252Fa833f08dafb5645c322b7179926c12db%252Fpa%252FYY61336_2452e37c357216672517c141e5ac2511.jpg') HTTP/1.1" 204 0
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_2452e37c357216672517c141e5ac2511.jpg saved to cache
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441
2026-03-30 12:20:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441, skipping ID generation
2026-03-30 12:20:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with scrape type 1
2026-03-30 12:20:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 sending to next pipeline
2026-03-30 12:20:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441, identifier: YY61336
2026-03-30 12:20:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with identifier: YY61336
2026-03-30 12:20:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with identifier: YY61336
2026-03-30 12:20:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e0162f4-cb7b-5e8b-9414-1324fc8f7441 with identifier: YY61336 to the API
2026-03-30 12:20:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_2452e37c357216672517c141e5ac2511.jpg>
{'auction_title': '',
'c_o_2_emission_value': 206,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 400,
'expiration_date': '2026-03-31T15:06:00Z',
'fuel_type': 'petrol',
'id': '2e0162f4-cb7b-5e8b-9414-1324fc8f7441',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY61336',
'listing': 'auction',
'location': 'IT, Trento',
'make': 'Audi',
'model': 'RS 3 Sportback',
'odometer': 50900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_2452e37c357216672517c141e5ac2511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_407823a63e69254725ea5040b15f1fb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_7446e64fbd42a5b3dc5fc6e5eb038701.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_59664ff966a03458430bf0e027254646.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_bbced98bd566a3bbda15dd2d1bc473db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_c266f08c5e77240b5d80ffda06363560.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_3d78d2f96575c1ab21dcec55c3558ce3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_b127ce83dd1a13f14e350719e4cf893e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_ec010d32357b60c982d4275deaaee9f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0162f4-cb7b-5e8b-9414-1324fc8f7441/2e0162f4-cb7b-5e8b-9414-1324fc8f7441_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/33/a833f08dafb5645c322b7179926c12db/pa/YY61336_71b2fbee0e8f8b2928b4aaa2aa58d1f5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2023}
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY61336%27 HTTP/1.1" 200 None
2026-03-30 12:20:38 [auto1.it] INFO: Saving data for YY61336: {'created_time': 1774873238.146513, 'last_price_update_time': 1774873238.146525, 'auction_closing_time': 1774969560.0}
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY61336') HTTP/1.1" 204 0
2026-03-30 12:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC69599> (referer: https://www.auto1.com/v1/car-details-view/VC69599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253ae7d5-ecde-5371-878c-210ac4b54d68 with identifier: VC69599
2026-03-30 12:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253ae7d5-ecde-5371-878c-210ac4b54d68 with scrape type 1
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 253ae7d5-ecde-5371-878c-210ac4b54d68
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_6cbb392b9116d9395f592a8873fee186.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6cbb392b9116d9395f592a8873fee186.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_de6182a4199724ee5597db8a14f75b01.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_de6182a4199724ee5597db8a14f75b01.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_60b45f0313c548567c41e7ade219f6f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_60b45f0313c548567c41e7ade219f6f9.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_6f0fa76324a227b021f6b4b6914705a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6f0fa76324a227b021f6b4b6914705a1.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_5cb14c1445e730fa6373f53326d13477.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_5cb14c1445e730fa6373f53326d13477.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_1e4229e5942e2a4eeec10f34f3724637.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e4229e5942e2a4eeec10f34f3724637.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_613c9a683018be87fec3262bc437e0e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_613c9a683018be87fec3262bc437e0e1.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_7429e0ea0f20eeddd2c5c3a300431587.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_7429e0ea0f20eeddd2c5c3a300431587.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_b72cc94ee8be0816ab8c5652c6ec7705.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_b72cc94ee8be0816ab8c5652c6ec7705.jpg already downloaded
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F9d%252Ffb9d9d953a6ebd5a65d9089684b70b8e%252Fpa%252FVC69599_1e7cec4ae062fa29beb228a21dd2c319.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e7cec4ae062fa29beb228a21dd2c319.jpg already downloaded
2026-03-30 12:20:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 253ae7d5-ecde-5371-878c-210ac4b54d68, identifier: VC69599
2026-03-30 12:20:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 253ae7d5-ecde-5371-878c-210ac4b54d68 with identifier: VC69599
2026-03-30 12:20:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 253ae7d5-ecde-5371-878c-210ac4b54d68 with identifier: VC69599
2026-03-30 12:20:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 253ae7d5-ecde-5371-878c-210ac4b54d68 with identifier: VC69599 to the API
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VC69599>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': 'Rental',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:49:48Z',
'fuel_type': 'diesel',
'id': '253ae7d5-ecde-5371-878c-210ac4b54d68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC69599',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'BMW',
'model': '3er',
'odometer': 222181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6cbb392b9116d9395f592a8873fee186.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_de6182a4199724ee5597db8a14f75b01.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_60b45f0313c548567c41e7ade219f6f9.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6f0fa76324a227b021f6b4b6914705a1.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_5cb14c1445e730fa6373f53326d13477.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e4229e5942e2a4eeec10f34f3724637.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_613c9a683018be87fec3262bc437e0e1.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_7429e0ea0f20eeddd2c5c3a300431587.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_b72cc94ee8be0816ab8c5652c6ec7705.jpg',
'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e7cec4ae062fa29beb228a21dd2c319.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6cbb392b9116d9395f592a8873fee186.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_de6182a4199724ee5597db8a14f75b01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_60b45f0313c548567c41e7ade219f6f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_6f0fa76324a227b021f6b4b6914705a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_5cb14c1445e730fa6373f53326d13477.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e4229e5942e2a4eeec10f34f3724637.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_613c9a683018be87fec3262bc437e0e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_7429e0ea0f20eeddd2c5c3a300431587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_b72cc94ee8be0816ab8c5652c6ec7705.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_253ae7d5-ecde-5371-878c-210ac4b54d68/253ae7d5-ecde-5371-878c-210ac4b54d68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/9d/fb9d9d953a6ebd5a65d9089684b70b8e/pa/VC69599_1e7cec4ae062fa29beb228a21dd2c319.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-07-08',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC69599%27 HTTP/1.1" 200 None
2026-03-30 12:20:44 [auto1.it] INFO: Saving data for VC69599: {'created_time': 1774873244.876195, 'last_price_update_time': 1774873244.876205, 'auction_closing_time': 1774972188.0}
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VC69599') HTTP/1.1" 204 0
2026-03-30 12:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV61096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR89969> (referer: https://www.auto1.com/v1/car-details-view/CR89969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4907124-26f9-5760-886c-d1427d5e9e0d with identifier: CR89969
2026-03-30 12:20:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4907124-26f9-5760-886c-d1427d5e9e0d with scrape type 1
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c4907124-26f9-5760-886c-d1427d5e9e0d
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_c02fb0d917c62212d585fe0bc215935d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c02fb0d917c62212d585fe0bc215935d.jpg already downloaded
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_540c732292f10b8e07cfd53bda9d11ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_540c732292f10b8e07cfd53bda9d11ce.jpg already downloaded
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_1f1955e3268ce98a743a7a9a0658ef3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_1f1955e3268ce98a743a7a9a0658ef3d.jpg already downloaded
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_7f88e21e0c9a1e61766b42576b2dbe3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_7f88e21e0c9a1e61766b42576b2dbe3c.jpg already downloaded
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_c2f23238f8c29a165fd2ab9b01842557.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c2f23238f8c29a165fd2ab9b01842557.jpg already downloaded
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fba%252F24ba8519f275336f3ee7ec37e6048f12%252Fpa%252FCR89969_857663289af279523d80b4e08f262db7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_857663289af279523d80b4e08f262db7.jpg already downloaded
2026-03-30 12:20:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c4907124-26f9-5760-886c-d1427d5e9e0d, identifier: CR89969
2026-03-30 12:20:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c4907124-26f9-5760-886c-d1427d5e9e0d with identifier: CR89969
2026-03-30 12:20:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c4907124-26f9-5760-886c-d1427d5e9e0d with identifier: CR89969
2026-03-30 12:20:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c4907124-26f9-5760-886c-d1427d5e9e0d with identifier: CR89969 to the API
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR89969>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:08:58Z',
'fuel_type': 'diesel',
'id': 'c4907124-26f9-5760-886c-d1427d5e9e0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR89969',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 177294,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c02fb0d917c62212d585fe0bc215935d.jpg',
'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_540c732292f10b8e07cfd53bda9d11ce.jpg',
'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_1f1955e3268ce98a743a7a9a0658ef3d.jpg',
'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_7f88e21e0c9a1e61766b42576b2dbe3c.jpg',
'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c2f23238f8c29a165fd2ab9b01842557.jpg',
'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_857663289af279523d80b4e08f262db7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c02fb0d917c62212d585fe0bc215935d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_540c732292f10b8e07cfd53bda9d11ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_1f1955e3268ce98a743a7a9a0658ef3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_7f88e21e0c9a1e61766b42576b2dbe3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_c2f23238f8c29a165fd2ab9b01842557.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4907124-26f9-5760-886c-d1427d5e9e0d/c4907124-26f9-5760-886c-d1427d5e9e0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/ba/24ba8519f275336f3ee7ec37e6048f12/pa/CR89969_857663289af279523d80b4e08f262db7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR89969%27 HTTP/1.1" 200 None
2026-03-30 12:20:47 [auto1.it] INFO: Saving data for CR89969: {'created_time': 1774873247.597819, 'last_price_update_time': 1774873247.597829, 'auction_closing_time': 1774969738.0}
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR89969') HTTP/1.1" 204 0
2026-03-30 12:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR51690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB82586> (referer: https://www.auto1.com/v1/car-details-view/JB82586/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a83afb1-e3db-5935-b4d8-4cf320202172 with identifier: JB82586
2026-03-30 12:20:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a83afb1-e3db-5935-b4d8-4cf320202172 with scrape type 1
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4a83afb1-e3db-5935-b4d8-4cf320202172
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5ebca0b21d22c3df5b1c0d9b3c7378%252Fpa%252FJB82586_3657efd64e7aff39715c0a72b8405575.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_3657efd64e7aff39715c0a72b8405575.jpg already downloaded
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5ebca0b21d22c3df5b1c0d9b3c7378%252Fpa%252FJB82586_6348151558cf2cf3f823c98ea13b74a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_6348151558cf2cf3f823c98ea13b74a1.jpg already downloaded
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5ebca0b21d22c3df5b1c0d9b3c7378%252Fpa%252FJB82586_1bcf6bd6b01636c35743b82dff62eb69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1bcf6bd6b01636c35743b82dff62eb69.jpg already downloaded
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5ebca0b21d22c3df5b1c0d9b3c7378%252Fpa%252FJB82586_35f494017cde17da2bb5b81d55d4044c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_35f494017cde17da2bb5b81d55d4044c.jpg already downloaded
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5ebca0b21d22c3df5b1c0d9b3c7378%252Fpa%252FJB82586_1f3161ecd8700c20106dac64541c8178.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1f3161ecd8700c20106dac64541c8178.jpg already downloaded
2026-03-30 12:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a83afb1-e3db-5935-b4d8-4cf320202172, identifier: JB82586
2026-03-30 12:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a83afb1-e3db-5935-b4d8-4cf320202172 with identifier: JB82586
2026-03-30 12:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a83afb1-e3db-5935-b4d8-4cf320202172 with identifier: JB82586
2026-03-30 12:20:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a83afb1-e3db-5935-b4d8-4cf320202172 with identifier: JB82586 to the API
2026-03-30 12:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:20:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB82586>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:24:59Z',
'fuel_type': 'petrol',
'id': '4a83afb1-e3db-5935-b4d8-4cf320202172',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB82586',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 105089,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_3657efd64e7aff39715c0a72b8405575.jpg',
'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_6348151558cf2cf3f823c98ea13b74a1.jpg',
'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1bcf6bd6b01636c35743b82dff62eb69.jpg',
'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_35f494017cde17da2bb5b81d55d4044c.jpg',
'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1f3161ecd8700c20106dac64541c8178.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a83afb1-e3db-5935-b4d8-4cf320202172/4a83afb1-e3db-5935-b4d8-4cf320202172_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_3657efd64e7aff39715c0a72b8405575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a83afb1-e3db-5935-b4d8-4cf320202172/4a83afb1-e3db-5935-b4d8-4cf320202172_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_6348151558cf2cf3f823c98ea13b74a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a83afb1-e3db-5935-b4d8-4cf320202172/4a83afb1-e3db-5935-b4d8-4cf320202172_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1bcf6bd6b01636c35743b82dff62eb69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a83afb1-e3db-5935-b4d8-4cf320202172/4a83afb1-e3db-5935-b4d8-4cf320202172_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_35f494017cde17da2bb5b81d55d4044c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a83afb1-e3db-5935-b4d8-4cf320202172/4a83afb1-e3db-5935-b4d8-4cf320202172_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5ebca0b21d22c3df5b1c0d9b3c7378/pa/JB82586_1f3161ecd8700c20106dac64541c8178.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-08-31',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 Now',
'transmission': 'manual',
'trim': 'Now',
'year': 2007}
2026-03-30 12:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB82586%27 HTTP/1.1" 200 None
2026-03-30 12:20:50 [auto1.it] INFO: Saving data for JB82586: {'created_time': 1774873250.164846, 'last_price_update_time': 1774873250.164858, 'auction_closing_time': 1774970699.0}
2026-03-30 12:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB82586') HTTP/1.1" 204 0
2026-03-30 12:20:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.160(s), this was the 1st time calling it.
2026-03-30 12:20:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.646827735099636 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC17055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX14576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:20:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG00977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX28669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW82904> (referer: https://www.auto1.com/v1/car-details-view/WW82904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e84ed26-cc39-5e69-bee8-59cb5597d093 with identifier: WW82904
2026-03-30 12:21:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e84ed26-cc39-5e69-bee8-59cb5597d093 with scrape type 1
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_18614ad139215105054bf9e82b16438c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_18614ad139215105054bf9e82b16438c.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_2db2029a1215c7aa788116edfa13fcfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_2db2029a1215c7aa788116edfa13fcfc.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_6be2068981ce350542bc05f80aff1e49.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_6be2068981ce350542bc05f80aff1e49.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_ea607e6feee9054d9de589750fb85175.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_ea607e6feee9054d9de589750fb85175.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_74370d266d9bbdad047ea2e839978a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_74370d266d9bbdad047ea2e839978a4a.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_f7fb59ce7efda5798ac524362b48e93e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f7fb59ce7efda5798ac524362b48e93e.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg not downloaded yet
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_3c18f8d74437b23ead67d8a725786fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_3c18f8d74437b23ead67d8a725786fc0.jpg not downloaded yet
2026-03-30 12:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU07793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_3c18f8d74437b23ead67d8a725786fc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601172e150>
2026-03-30 12:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_3c18f8d74437b23ead67d8a725786fc0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_3c18f8d74437b23ead67d8a725786fc0.jpg saved to cache
2026-03-30 12:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:04 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 18 pages/min), scraped 56 items (at 8 items/min)
2026-03-30 12:21:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV61096> (referer: https://www.auto1.com/v1/car-details-view/GV61096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-03-30 12:21:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d5133-0395-5de4-8feb-3487264009cc with scrape type 1
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_397f30f849a6e4eec4728634503d0d75.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_c45d846fad6ce59986ee24bf76428fdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg not downloaded yet
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012881790>
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg saved to cache
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_0e227978d62afa26e03b176e568b61c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg not downloaded yet
2026-03-30 12:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f7fb59ce7efda5798ac524362b48e93e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_d7f593b25e710286b5b15bd42ae71723.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_9cf4bb47289068ced595f39df327b884.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg not downloaded yet
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_22931f4c002991e2c9d42b9e350c5824.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg not downloaded yet
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5e3d0>
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_f7fb59ce7efda5798ac524362b48e93e.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f7fb59ce7efda5798ac524362b48e93e.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a7bad0>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f4bf50>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_22931f4c002991e2c9d42b9e350c5824.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb4490>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_9cf4bb47289068ced595f39df327b884.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a7b290>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f42bd0>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_d7f593b25e710286b5b15bd42ae71723.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM07147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fe1310>
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg saved to cache
2026-03-30 12:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1fb10>
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_0e227978d62afa26e03b176e568b61c4.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg saved to cache
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e0790>
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_c45d846fad6ce59986ee24bf76428fdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg saved to cache
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fdead0>
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg saved to cache
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010914ed0>
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fa8%252F68a8b29649147793bf259e41699d73e8%252Fpa%252FGV61096_397f30f849a6e4eec4728634503d0d75.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg saved to cache
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-03-30 12:21:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee0d5133-0395-5de4-8feb-3487264009cc, skipping ID generation
2026-03-30 12:21:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d5133-0395-5de4-8feb-3487264009cc with scrape type 1
2026-03-30 12:21:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee0d5133-0395-5de4-8feb-3487264009cc sending to next pipeline
2026-03-30 12:21:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee0d5133-0395-5de4-8feb-3487264009cc, identifier: GV61096
2026-03-30 12:21:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-03-30 12:21:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-03-30 12:21:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096 to the API
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:17:35Z',
'fuel_type': 'hybrid',
'id': 'ee0d5133-0395-5de4-8feb-3487264009cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV61096',
'listing': 'auction',
'location': 'IT, Agnano (NA)',
'make': 'Peugeot',
'model': '408',
'odometer': 40412,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 408 1.6 Hybrid GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2024}
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV61096%27 HTTP/1.1" 200 None
2026-03-30 12:21:06 [auto1.it] INFO: Saving data for GV61096: {'created_time': 1774873266.843917, 'last_price_update_time': 1774873266.843929, 'auction_closing_time': 1774970255.0}
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV61096') HTTP/1.1" 204 0
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_74370d266d9bbdad047ea2e839978a4a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR51690> (referer: https://www.auto1.com/v1/car-details-view/GR51690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF40578> (referer: https://www.auto1.com/v1/car-details-view/LF40578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f60a50>
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_74370d266d9bbdad047ea2e839978a4a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_74370d266d9bbdad047ea2e839978a4a.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b912a186-ae84-59d3-b164-647c38806522 with identifier: GR51690
2026-03-30 12:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b912a186-ae84-59d3-b164-647c38806522 with scrape type 1
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_0b3ea999945f8034b1c3f182cee07302.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_0b3ea999945f8034b1c3f182cee07302.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg not downloaded yet
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_ea607e6feee9054d9de589750fb85175.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_048006fd5d09982ac9e4155e1e268abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_048006fd5d09982ac9e4155e1e268abe.jpg not downloaded yet
2026-03-30 12:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da4236e-5da7-59c5-a0d4-83195fc47c48 with identifier: LF40578
2026-03-30 12:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da4236e-5da7-59c5-a0d4-83195fc47c48 with scrape type 1
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_b1cce41d75e5181389e91189e80a3f0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_b1cce41d75e5181389e91189e80a3f0b.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_afd559b13b265bc491e7ffa1befa24e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_afd559b13b265bc491e7ffa1befa24e0.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_9c763e7eaba91662da2a2875e7304609.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_9c763e7eaba91662da2a2875e7304609.jpg not downloaded yet
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_6be2068981ce350542bc05f80aff1e49.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_81852687f6899812f9cbd761713ab418.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_81852687f6899812f9cbd761713ab418.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_571c4f3c4d0f5b1b359789e473928829.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_571c4f3c4d0f5b1b359789e473928829.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_9db13e24e5b5b21c56226c215bbc844a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_9db13e24e5b5b21c56226c215bbc844a.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_7a94347612e0694fbd2dac68d507175f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_7a94347612e0694fbd2dac68d507175f.jpg not downloaded yet
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e2510>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_ea607e6feee9054d9de589750fb85175.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_ea607e6feee9054d9de589750fb85175.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg not downloaded yet
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_2db2029a1215c7aa788116edfa13fcfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_e781ff460b95291323b2cadb274403ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_e781ff460b95291323b2cadb274403ef.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg not downloaded yet
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fbab90>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_6be2068981ce350542bc05f80aff1e49.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_6be2068981ce350542bc05f80aff1e49.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_455abe8b72d874c451a7aee02084dd66.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_455abe8b72d874c451a7aee02084dd66.jpg not downloaded yet
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg not downloaded yet
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b06cd0>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_2db2029a1215c7aa788116edfa13fcfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_2db2029a1215c7aa788116edfa13fcfc.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aac5d0>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_d52aa23d71d0c2db8ae232af373a657e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_d52aa23d71d0c2db8ae232af373a657e.jpg not downloaded yet
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_afd559b13b265bc491e7ffa1befa24e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a48b10>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a976d0>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_afd559b13b265bc491e7ffa1befa24e0.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_afd559b13b265bc491e7ffa1befa24e0.jpg saved to cache
2026-03-30 12:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_d52aa23d71d0c2db8ae232af373a657e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e2d750>
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010914d50>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF70774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2f590>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_d52aa23d71d0c2db8ae232af373a657e.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_d52aa23d71d0c2db8ae232af373a657e.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_455abe8b72d874c451a7aee02084dd66.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_e781ff460b95291323b2cadb274403ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6a390>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_455abe8b72d874c451a7aee02084dd66.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_455abe8b72d874c451a7aee02084dd66.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff5bd0>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_e781ff460b95291323b2cadb274403ef.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_e781ff460b95291323b2cadb274403ef.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e99ad0>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fcc950>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2e110>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg saved to cache
2026-03-30 12:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_9db13e24e5b5b21c56226c215bbc844a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_7a94347612e0694fbd2dac68d507175f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_571c4f3c4d0f5b1b359789e473928829.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fcc510>
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_9db13e24e5b5b21c56226c215bbc844a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_9db13e24e5b5b21c56226c215bbc844a.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a27890>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_7a94347612e0694fbd2dac68d507175f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_7a94347612e0694fbd2dac68d507175f.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_81852687f6899812f9cbd761713ab418.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG60482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a7bbd0>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_571c4f3c4d0f5b1b359789e473928829.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_571c4f3c4d0f5b1b359789e473928829.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_9c763e7eaba91662da2a2875e7304609.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL76635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127cdc50>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_81852687f6899812f9cbd761713ab418.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_81852687f6899812f9cbd761713ab418.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_b1cce41d75e5181389e91189e80a3f0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_0b3ea999945f8034b1c3f182cee07302.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a276d0>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_9c763e7eaba91662da2a2875e7304609.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_9c763e7eaba91662da2a2875e7304609.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_18614ad139215105054bf9e82b16438c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010903290>
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fa9%252F82a9da00ee0b24963f328686b64c549f%252Fpa%252FLF40578_b1cce41d75e5181389e91189e80a3f0b.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_b1cce41d75e5181389e91189e80a3f0b.jpg saved to cache
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da4236e-5da7-59c5-a0d4-83195fc47c48
2026-03-30 12:21:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da4236e-5da7-59c5-a0d4-83195fc47c48, skipping ID generation
2026-03-30 12:21:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da4236e-5da7-59c5-a0d4-83195fc47c48 with scrape type 1
2026-03-30 12:21:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da4236e-5da7-59c5-a0d4-83195fc47c48 sending to next pipeline
2026-03-30 12:21:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5da4236e-5da7-59c5-a0d4-83195fc47c48, identifier: LF40578
2026-03-30 12:21:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5da4236e-5da7-59c5-a0d4-83195fc47c48 with identifier: LF40578
2026-03-30 12:21:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5da4236e-5da7-59c5-a0d4-83195fc47c48 with identifier: LF40578
2026-03-30 12:21:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5da4236e-5da7-59c5-a0d4-83195fc47c48 with identifier: LF40578 to the API
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_b1cce41d75e5181389e91189e80a3f0b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.9L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:37:39Z',
'fuel_type': 'diesel',
'id': '5da4236e-5da7-59c5-a0d4-83195fc47c48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF40578',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 67693,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_b1cce41d75e5181389e91189e80a3f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_9c763e7eaba91662da2a2875e7304609.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_571c4f3c4d0f5b1b359789e473928829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_7a94347612e0694fbd2dac68d507175f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_4a8413379e22f3057dde9dcdece0e5b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_e781ff460b95291323b2cadb274403ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_6fbdfab4d79a43636e751dfb6af658ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_455abe8b72d874c451a7aee02084dd66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_3d3eca0c1200b08d4a1dd371f9fc1ee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da4236e-5da7-59c5-a0d4-83195fc47c48/5da4236e-5da7-59c5-a0d4-83195fc47c48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/a9/82a9da00ee0b24963f328686b64c549f/pa/LF40578_d52aa23d71d0c2db8ae232af373a657e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2020}
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF40578%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [auto1.it] INFO: Saving data for LF40578: {'created_time': 1774873270.032615, 'last_price_update_time': 1774873270.032624, 'auction_closing_time': 1774971459.0}
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF40578') HTTP/1.1" 204 0
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_048006fd5d09982ac9e4155e1e268abe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX14576> (referer: https://www.auto1.com/v1/car-details-view/TX14576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012818b10>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_0b3ea999945f8034b1c3f182cee07302.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_0b3ea999945f8034b1c3f182cee07302.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f49110>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd9f50>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f41e10>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_18614ad139215105054bf9e82b16438c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_18614ad139215105054bf9e82b16438c.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e07d0>
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fd7%252F02d72f9b3d1fd1b39cc76963f3e01542%252Fpa%252FGR51690_048006fd5d09982ac9e4155e1e268abe.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_048006fd5d09982ac9e4155e1e268abe.jpg saved to cache
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b912a186-ae84-59d3-b164-647c38806522
2026-03-30 12:21:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b912a186-ae84-59d3-b164-647c38806522, skipping ID generation
2026-03-30 12:21:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b912a186-ae84-59d3-b164-647c38806522 with scrape type 1
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b912a186-ae84-59d3-b164-647c38806522 sending to next pipeline
2026-03-30 12:21:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b912a186-ae84-59d3-b164-647c38806522, identifier: GR51690
2026-03-30 12:21:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with identifier: TX14576
2026-03-30 12:21:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with scrape type 1
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg not downloaded yet
2026-03-30 12:21:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b912a186-ae84-59d3-b164-647c38806522 with identifier: GR51690
2026-03-30 12:21:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b912a186-ae84-59d3-b164-647c38806522 with identifier: GR51690
2026-03-30 12:21:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b912a186-ae84-59d3-b164-647c38806522 with identifier: GR51690 to the API
2026-03-30 12:21:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_048006fd5d09982ac9e4155e1e268abe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:05:56Z',
'fuel_type': 'petrol',
'id': 'b912a186-ae84-59d3-b164-647c38806522',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR51690',
'listing': 'auction',
'location': 'IT, Santo Stefano di Magra SP',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 111886,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_0b3ea999945f8034b1c3f182cee07302.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_c8ce17b0172e9f10d088adf3f683bd8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_048006fd5d09982ac9e4155e1e268abe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2615868,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_afd559b13b265bc491e7ffa1befa24e0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_81852687f6899812f9cbd761713ab418.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_9db13e24e5b5b21c56226c215bbc844a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2568428,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_401a9e3a3f9862f5bd3a171be5f2f934.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460319,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_8db0ec588c6f788e5635dcd9d6f67b2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_7a3236f1b6d4e568916c3d0998c7421c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b912a186-ae84-59d3-b164-647c38806522/b912a186-ae84-59d3-b164-647c38806522_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742268,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img02/d7/02d72f9b3d1fd1b39cc76963f3e01542/pa/GR51690_b2049dd3ff006ec52ad17d679ef9b64d.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-21',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up!',
'transmission': 'manual',
'trim': 'Move',
'year': 2018}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR51690%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.it] INFO: Saving data for GR51690: {'created_time': 1774873271.239088, 'last_price_update_time': 1774873271.239097, 'auction_closing_time': 1774969556.0}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR51690') HTTP/1.1" 204 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_353d681f5122930915f41cc11d959cd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_353d681f5122930915f41cc11d959cd4.jpg not downloaded yet
2026-03-30 12:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG00977> (referer: https://www.auto1.com/v1/car-details-view/NG00977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg not downloaded yet
2026-03-30 12:21:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb8c50>
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd1%252F96d139229c9a00ad1c28b7889b30efac%252Fpa%252FWW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg saved to cache
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e84ed26-cc39-5e69-bee8-59cb5597d093
2026-03-30 12:21:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e84ed26-cc39-5e69-bee8-59cb5597d093, skipping ID generation
2026-03-30 12:21:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e84ed26-cc39-5e69-bee8-59cb5597d093 with scrape type 1
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e84ed26-cc39-5e69-bee8-59cb5597d093 sending to next pipeline
2026-03-30 12:21:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e84ed26-cc39-5e69-bee8-59cb5597d093, identifier: WW82904
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_3f872051221e4c728ff8c70dbf9c6740.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_3f872051221e4c728ff8c70dbf9c6740.jpg not downloaded yet
2026-03-30 12:21:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e84ed26-cc39-5e69-bee8-59cb5597d093 with identifier: WW82904
2026-03-30 12:21:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e84ed26-cc39-5e69-bee8-59cb5597d093 with identifier: WW82904
2026-03-30 12:21:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e84ed26-cc39-5e69-bee8-59cb5597d093 with identifier: WW82904 to the API
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:28:39Z',
'fuel_type': 'diesel',
'id': '5e84ed26-cc39-5e69-bee8-59cb5597d093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW82904',
'listing': 'auction',
'location': 'IT, Fiumicino',
'make': 'Peugeot',
'model': '3008',
'odometer': 54967,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_1ce2f7a44e3fdc4f9f170c7478c95bfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_18614ad139215105054bf9e82b16438c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_57022fd38e124db376c5c71ccc8f5d8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_2db2029a1215c7aa788116edfa13fcfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_6be2068981ce350542bc05f80aff1e49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_ea607e6feee9054d9de589750fb85175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_74370d266d9bbdad047ea2e839978a4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f7fb59ce7efda5798ac524362b48e93e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_f57a2b0a7d6982f51e95e18b702c2335.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e84ed26-cc39-5e69-bee8-59cb5597d093/5e84ed26-cc39-5e69-bee8-59cb5597d093_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/d1/96d139229c9a00ad1c28b7889b30efac/pa/WW82904_3c18f8d74437b23ead67d8a725786fc0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW82904%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [auto1.it] INFO: Saving data for WW82904: {'created_time': 1774873271.908823, 'last_price_update_time': 1774873271.908835, 'auction_closing_time': 1774970919.0}
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW82904') HTTP/1.1" 204 0
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_ecc332145d3abe773077636289e13730.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_ecc332145d3abe773077636289e13730.jpg not downloaded yet
2026-03-30 12:21:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with identifier: NG00977
2026-03-30 12:21:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with scrape type 1
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg not downloaded yet
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_e5a34456636ef3ed26c748bd588c2f76.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_e5a34456636ef3ed26c748bd588c2f76.jpg not downloaded yet
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_b10967a878df28e47c2cefabd780bfa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_b10967a878df28e47c2cefabd780bfa3.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_c1b56835259e72efda848411111fe848.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_c1b56835259e72efda848411111fe848.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_7426a9910a507021dbe82149c76650db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_7426a9910a507021dbe82149c76650db.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_269a058cafe0a6e31da9899f8f244d3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_269a058cafe0a6e31da9899f8f244d3a.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg not downloaded yet
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_9207ba77859d822e22731d33433ef30f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_9207ba77859d822e22731d33433ef30f.jpg not downloaded yet
2026-03-30 12:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_353d681f5122930915f41cc11d959cd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd8a50>
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_353d681f5122930915f41cc11d959cd4.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_353d681f5122930915f41cc11d959cd4.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_9207ba77859d822e22731d33433ef30f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e05650>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_9207ba77859d822e22731d33433ef30f.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_9207ba77859d822e22731d33433ef30f.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e0bd0>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_269a058cafe0a6e31da9899f8f244d3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a424d0>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_269a058cafe0a6e31da9899f8f244d3a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_269a058cafe0a6e31da9899f8f244d3a.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a42d50>
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg saved to cache
2026-03-30 12:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_7426a9910a507021dbe82149c76650db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3a810>
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_7426a9910a507021dbe82149c76650db.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_7426a9910a507021dbe82149c76650db.jpg saved to cache
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_c1b56835259e72efda848411111fe848.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e24f50>
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_c1b56835259e72efda848411111fe848.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_c1b56835259e72efda848411111fe848.jpg saved to cache
2026-03-30 12:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_b10967a878df28e47c2cefabd780bfa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010937810>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_b10967a878df28e47c2cefabd780bfa3.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_b10967a878df28e47c2cefabd780bfa3.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a45590>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg saved to cache
2026-03-30 12:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_e5a34456636ef3ed26c748bd588c2f76.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a95e10>
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_e5a34456636ef3ed26c748bd588c2f76.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_e5a34456636ef3ed26c748bd588c2f76.jpg saved to cache
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e39d0>
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F84%252F1b84aad7992cd721248884e2a8610778%252Fpa%252FNG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg saved to cache
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7
2026-03-30 12:21:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7, skipping ID generation
2026-03-30 12:21:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with scrape type 1
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 sending to next pipeline
2026-03-30 12:21:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7, identifier: NG00977
2026-03-30 12:21:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with identifier: NG00977
2026-03-30 12:21:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with identifier: NG00977
2026-03-30 12:21:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7 with identifier: NG00977 to the API
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '0.7L',
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:31:51Z',
'fuel_type': 'petrol',
'id': 'f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG00977',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Smart',
'model': 'fortwo',
'odometer': 99994,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_6a5b134c8f7321c821d4124731ebc7ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_99d7efa1c63454cd6beb33bde16dbfba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_c1b56835259e72efda848411111fe848.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ac3e218e4a81db31840845de2f4a4d4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7/f0b8b9ea-1801-5eba-85c6-0d5a6c0ef5c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/84/1b84aad7992cd721248884e2a8610778/pa/NG00977_ee5ca2aba61e547c5f66fdd28bce4208.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-12-28',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.7 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2003}
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG00977%27 HTTP/1.1" 200 None
2026-03-30 12:21:16 [auto1.it] INFO: Saving data for NG00977: {'created_time': 1774873276.621956, 'last_price_update_time': 1774873276.621965, 'auction_closing_time': 1774971111.0}
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG00977') HTTP/1.1" 204 0
2026-03-30 12:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_ecc332145d3abe773077636289e13730.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8f390>
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_ecc332145d3abe773077636289e13730.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_ecc332145d3abe773077636289e13730.jpg saved to cache
2026-03-30 12:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_3f872051221e4c728ff8c70dbf9c6740.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8c050>
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_3f872051221e4c728ff8c70dbf9c6740.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_3f872051221e4c728ff8c70dbf9c6740.jpg saved to cache
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2efd0>
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg saved to cache
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010941890>
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F1f%252F331f1700d74b82deca9cafb50b040b0c%252Fpa%252FTX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg saved to cache
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4
2026-03-30 12:21:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb43ad61-cc23-5c21-bf9c-14f24f6318d4, skipping ID generation
2026-03-30 12:21:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with scrape type 1
2026-03-30 12:21:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb43ad61-cc23-5c21-bf9c-14f24f6318d4 sending to next pipeline
2026-03-30 12:21:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb43ad61-cc23-5c21-bf9c-14f24f6318d4, identifier: TX14576
2026-03-30 12:21:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with identifier: TX14576
2026-03-30 12:21:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with identifier: TX14576
2026-03-30 12:21:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb43ad61-cc23-5c21-bf9c-14f24f6318d4 with identifier: TX14576 to the API
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:22:50Z',
'fuel_type': 'petrol',
'id': 'eb43ad61-cc23-5c21-bf9c-14f24f6318d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX14576',
'listing': 'auction',
'location': 'IT, Genova',
'make': 'Hyundai',
'model': 'i20',
'odometer': 51641,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007342,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_1c96469070c5a1e9eaa9ad09712334ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060145,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_353d681f5122930915f41cc11d959cd4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_90c976e6a5663a512aad2a1cf29dbd00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1981393,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_3f872051221e4c728ff8c70dbf9c6740.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_ecc332145d3abe773077636289e13730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004674,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_e5a34456636ef3ed26c748bd588c2f76.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1949343,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_b10967a878df28e47c2cefabd780bfa3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2029657,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_7426a9910a507021dbe82149c76650db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_269a058cafe0a6e31da9899f8f244d3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb43ad61-cc23-5c21-bf9c-14f24f6318d4/eb43ad61-cc23-5c21-bf9c-14f24f6318d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/1f/331f1700d74b82deca9cafb50b040b0c/pa/TX14576_9207ba77859d822e22731d33433ef30f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.2 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2010}
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX14576%27 HTTP/1.1" 200 None
2026-03-30 12:21:18 [auto1.it] INFO: Saving data for TX14576: {'created_time': 1774873278.327626, 'last_price_update_time': 1774873278.327637, 'auction_closing_time': 1774970570.0}
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TX14576') HTTP/1.1" 204 0
2026-03-30 12:21:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.791(s), this was the 2nd time calling it.
2026-03-30 12:21:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.3885468242223205 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM07147> (referer: https://www.auto1.com/v1/car-details-view/SM07147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9f6349-8181-5059-9524-d9c3982dc03b with identifier: SM07147
2026-03-30 12:21:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9f6349-8181-5059-9524-d9c3982dc03b with scrape type 1
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg not downloaded yet
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_789f2e894b659234f32753da669ab073.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_789f2e894b659234f32753da669ab073.jpg not downloaded yet
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_fda9f3ea4442433f0a00e66b356442a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_fda9f3ea4442433f0a00e66b356442a1.jpg not downloaded yet
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg not downloaded yet
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg not downloaded yet
2026-03-30 12:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF70774> (referer: https://www.auto1.com/v1/car-details-view/VF70774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e63aa2-37e6-5692-83ee-0e27353214af with identifier: VF70774
2026-03-30 12:21:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e63aa2-37e6-5692-83ee-0e27353214af with scrape type 1
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_c10a46f429898004d96b390ec22d90db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_c10a46f429898004d96b390ec22d90db.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_f401962623a1d11f7f5f9fa23028a6da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_f401962623a1d11f7f5f9fa23028a6da.jpg not downloaded yet
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a38510>
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg saved to cache
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_2219e0848169e06cb19aa4e107ff0898.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_2219e0848169e06cb19aa4e107ff0898.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg not downloaded yet
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_03654ea2c22ff47c72560adcf074e1d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_03654ea2c22ff47c72560adcf074e1d6.jpg not downloaded yet
2026-03-30 12:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_6237fdcf1b6d3b481e75546750622a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_6237fdcf1b6d3b481e75546750622a15.jpg not downloaded yet
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b06f10>
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg saved to cache
2026-03-30 12:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG60482> (referer: https://www.auto1.com/v1/car-details-view/NG60482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4011b17a-edb2-543d-85dc-68a19cd17c0b with identifier: NG60482
2026-03-30 12:21:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4011b17a-edb2-543d-85dc-68a19cd17c0b with scrape type 1
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4011b17a-edb2-543d-85dc-68a19cd17c0b
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_479082a1d18add4ebfd4bd1a72f33cb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_479082a1d18add4ebfd4bd1a72f33cb5.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_0bdc5b209710f785b09d6a2ee66d11b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_0bdc5b209710f785b09d6a2ee66d11b9.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_794beef5abf482103ae246ea31d20a57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_794beef5abf482103ae246ea31d20a57.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_72adc45da481522f19528c402bcd1840.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_72adc45da481522f19528c402bcd1840.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_202b5e035a13b2f5c9c2577b3cdf60f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_202b5e035a13b2f5c9c2577b3cdf60f3.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_29db243e383b53e143a4b08388dcd0df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_29db243e383b53e143a4b08388dcd0df.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_67283d52d777a9bb7d708fe69ced4e0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_67283d52d777a9bb7d708fe69ced4e0c.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_6fd288faf5264c5ff6aed21348e43ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_6fd288faf5264c5ff6aed21348e43ce0.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_98609c0e4f7cdb049550b285d980cabb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_98609c0e4f7cdb049550b285d980cabb.jpg already downloaded
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb9%252F1bb9e8d165525b80988ffa233153071a%252Fpa%252FNG60482_200ed297df1be7a7564bb293bb4fe5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_200ed297df1be7a7564bb293bb4fe5b1.jpg already downloaded
2026-03-30 12:21:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4011b17a-edb2-543d-85dc-68a19cd17c0b, identifier: NG60482
2026-03-30 12:21:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4011b17a-edb2-543d-85dc-68a19cd17c0b with identifier: NG60482
2026-03-30 12:21:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4011b17a-edb2-543d-85dc-68a19cd17c0b with identifier: NG60482
2026-03-30 12:21:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4011b17a-edb2-543d-85dc-68a19cd17c0b with identifier: NG60482 to the API
2026-03-30 12:21:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG60482>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:31:58Z',
'fuel_type': 'diesel',
'id': '4011b17a-edb2-543d-85dc-68a19cd17c0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG60482',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 212875,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_479082a1d18add4ebfd4bd1a72f33cb5.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_0bdc5b209710f785b09d6a2ee66d11b9.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_794beef5abf482103ae246ea31d20a57.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_72adc45da481522f19528c402bcd1840.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_202b5e035a13b2f5c9c2577b3cdf60f3.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_29db243e383b53e143a4b08388dcd0df.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_67283d52d777a9bb7d708fe69ced4e0c.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_6fd288faf5264c5ff6aed21348e43ce0.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_98609c0e4f7cdb049550b285d980cabb.jpg',
'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_200ed297df1be7a7564bb293bb4fe5b1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_479082a1d18add4ebfd4bd1a72f33cb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2075815,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_0bdc5b209710f785b09d6a2ee66d11b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1996217,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_794beef5abf482103ae246ea31d20a57.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_72adc45da481522f19528c402bcd1840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_202b5e035a13b2f5c9c2577b3cdf60f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_29db243e383b53e143a4b08388dcd0df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_67283d52d777a9bb7d708fe69ced4e0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_6fd288faf5264c5ff6aed21348e43ce0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_98609c0e4f7cdb049550b285d980cabb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4011b17a-edb2-543d-85dc-68a19cd17c0b/4011b17a-edb2-543d-85dc-68a19cd17c0b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/b9/1bb9e8d165525b80988ffa233153071a/pa/NG60482_200ed297df1be7a7564bb293bb4fe5b1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-12',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2015}
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG60482%27 HTTP/1.1" 200 None
2026-03-30 12:21:22 [auto1.it] INFO: Saving data for NG60482: {'created_time': 1774873282.156985, 'last_price_update_time': 1774873282.156995, 'auction_closing_time': 1774971118.0}
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NG60482') HTTP/1.1" 204 0
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_6237fdcf1b6d3b481e75546750622a15.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_03654ea2c22ff47c72560adcf074e1d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb5a10>
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_6237fdcf1b6d3b481e75546750622a15.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_6237fdcf1b6d3b481e75546750622a15.jpg saved to cache
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003eaaf90>
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_03654ea2c22ff47c72560adcf074e1d6.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_03654ea2c22ff47c72560adcf074e1d6.jpg saved to cache
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e26190>
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg saved to cache
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_2219e0848169e06cb19aa4e107ff0898.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601172e8d0>
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_2219e0848169e06cb19aa4e107ff0898.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_2219e0848169e06cb19aa4e107ff0898.jpg saved to cache
2026-03-30 12:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_f401962623a1d11f7f5f9fa23028a6da.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd5390>
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg saved to cache
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1c510>
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_f401962623a1d11f7f5f9fa23028a6da.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_f401962623a1d11f7f5f9fa23028a6da.jpg saved to cache
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003eaa090>
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg saved to cache
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_c10a46f429898004d96b390ec22d90db.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108c99d0>
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_c10a46f429898004d96b390ec22d90db.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_c10a46f429898004d96b390ec22d90db.jpg saved to cache
2026-03-30 12:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC73046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_789f2e894b659234f32753da669ab073.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2cc50>
2026-03-30 12:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg saved to cache
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1ced0>
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Ff3%252Fbbf39dcaa7a590cc63b40f453a6ef070%252Fpa%252FVF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg saved to cache
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9e63aa2-37e6-5692-83ee-0e27353214af
2026-03-30 12:21:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9e63aa2-37e6-5692-83ee-0e27353214af, skipping ID generation
2026-03-30 12:21:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e63aa2-37e6-5692-83ee-0e27353214af with scrape type 1
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9e63aa2-37e6-5692-83ee-0e27353214af sending to next pipeline
2026-03-30 12:21:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9e63aa2-37e6-5692-83ee-0e27353214af, identifier: VF70774
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a55350>
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_789f2e894b659234f32753da669ab073.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_789f2e894b659234f32753da669ab073.jpg saved to cache
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9e63aa2-37e6-5692-83ee-0e27353214af with identifier: VF70774
2026-03-30 12:21:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9e63aa2-37e6-5692-83ee-0e27353214af with identifier: VF70774
2026-03-30 12:21:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9e63aa2-37e6-5692-83ee-0e27353214af with identifier: VF70774 to the API
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:01:24Z',
'fuel_type': 'diesel',
'id': 'd9e63aa2-37e6-5692-83ee-0e27353214af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF70774',
'listing': 'auction',
'location': 'IT, Parma',
'make': 'Audi',
'model': 'Q3',
'odometer': 126003,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383732,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_1dfd34ff1e4443cae885fab7702e38ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_c10a46f429898004d96b390ec22d90db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2556807,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_9b16da6ec8eef4fe8e7fb87fadc1d61a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2572795,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_e1af9c03ccb51e0c77cc579955a97de1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_f401962623a1d11f7f5f9fa23028a6da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_2219e0848169e06cb19aa4e107ff0898.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2395142,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_b49145ceb54ab550f3d38021e72e7b7d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2508469,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_0aad19c1a11408018fecf0aa1c6452e7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442540,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_03654ea2c22ff47c72560adcf074e1d6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9e63aa2-37e6-5692-83ee-0e27353214af/d9e63aa2-37e6-5692-83ee-0e27353214af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/f3/bbf39dcaa7a590cc63b40f453a6ef070/pa/VF70774_6237fdcf1b6d3b481e75546750622a15.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF70774%27 HTTP/1.1" 200 None
2026-03-30 12:21:24 [auto1.it] INFO: Saving data for VF70774: {'created_time': 1774873284.753904, 'last_price_update_time': 1774873284.753915, 'auction_closing_time': 1774969284.0}
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF70774') HTTP/1.1" 204 0
2026-03-30 12:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_fda9f3ea4442433f0a00e66b356442a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e2a90>
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_fda9f3ea4442433f0a00e66b356442a1.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_fda9f3ea4442433f0a00e66b356442a1.jpg saved to cache
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109033d0>
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fcf%252Ff0cf63cb4a94249fad450a122b65e570%252Fpa%252FSM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg') HTTP/1.1" 204 0
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg saved to cache
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d9f6349-8181-5059-9524-d9c3982dc03b
2026-03-30 12:21:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d9f6349-8181-5059-9524-d9c3982dc03b, skipping ID generation
2026-03-30 12:21:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9f6349-8181-5059-9524-d9c3982dc03b with scrape type 1
2026-03-30 12:21:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d9f6349-8181-5059-9524-d9c3982dc03b sending to next pipeline
2026-03-30 12:21:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d9f6349-8181-5059-9524-d9c3982dc03b, identifier: SM07147
2026-03-30 12:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d9f6349-8181-5059-9524-d9c3982dc03b with identifier: SM07147
2026-03-30 12:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d9f6349-8181-5059-9524-d9c3982dc03b with identifier: SM07147
2026-03-30 12:21:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d9f6349-8181-5059-9524-d9c3982dc03b with identifier: SM07147 to the API
2026-03-30 12:21:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:40Z',
'fuel_type': 'diesel',
'id': '0d9f6349-8181-5059-9524-d9c3982dc03b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM07147',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Ford',
'model': 'C-Max',
'odometer': 159607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_3b9291e8ab5a5ea12b6610dab7f49bb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_789f2e894b659234f32753da669ab073.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_fda9f3ea4442433f0a00e66b356442a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8fe28a09d4bc426f61bf9989e20e27d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d9f6349-8181-5059-9524-d9c3982dc03b/0d9f6349-8181-5059-9524-d9c3982dc03b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/cf/f0cf63cb4a94249fad450a122b65e570/pa/SM07147_8b282a1411b6ffa0e5191780c48f5e7c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2008}
2026-03-30 12:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM07147%27 HTTP/1.1" 200 None
2026-03-30 12:21:26 [auto1.it] INFO: Saving data for SM07147: {'created_time': 1774873286.248519, 'last_price_update_time': 1774873286.24853, 'auction_closing_time': 1774969720.0}
2026-03-30 12:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM07147') HTTP/1.1" 204 0
2026-03-30 12:21:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF51133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:21:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:04 [scrapy.extensions.logstats] INFO: Crawled 106 pages (at 14 pages/min), scraped 65 items (at 9 items/min)
2026-03-30 12:22:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:22:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.070(s), this was the 1st time calling it.
2026-03-30 12:22:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.514872860129957 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.579(s), this was the 1st time calling it.
2026-03-30 12:22:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7051545115339444 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR88272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB45776> (referer: https://www.auto1.com/v1/car-details-view/HB45776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92766626-98ba-51ef-ab9c-f4cd85d66743 with identifier: HB45776
2026-03-30 12:22:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92766626-98ba-51ef-ab9c-f4cd85d66743 with scrape type 1
2026-03-30 12:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92766626-98ba-51ef-ab9c-f4cd85d66743
2026-03-30 12:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_468b1b54b58a1df26237bbf2bb60d87a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_468b1b54b58a1df26237bbf2bb60d87a.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_a0051bc94d4fcc79c4809e5834b56763.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_a0051bc94d4fcc79c4809e5834b56763.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_e4d28ffbcc5a285aeb9d404e1cbf20cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_e4d28ffbcc5a285aeb9d404e1cbf20cd.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_ddaa7468564428f287e3ad6fc25f7138.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_ddaa7468564428f287e3ad6fc25f7138.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_f37b607619c8eac207f2863ed7586245.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_f37b607619c8eac207f2863ed7586245.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_1b87989692bc4dee1d9ed9a259ef8582.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1b87989692bc4dee1d9ed9a259ef8582.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_69a776e98c71c20875b20834d12e8a39.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_69a776e98c71c20875b20834d12e8a39.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_d2f3973c32577a9a0aa5a344ee2500d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_d2f3973c32577a9a0aa5a344ee2500d4.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_555e703cd577579ab07c291ee8a2b546.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_555e703cd577579ab07c291ee8a2b546.jpg already downloaded
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F79%252F59791b3437a65d67a6d0cacf0670a5ee%252Fpa%252FHB45776_1a5e6e7cb863180f416f49a69217535a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1a5e6e7cb863180f416f49a69217535a.jpg already downloaded
2026-03-30 12:22:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92766626-98ba-51ef-ab9c-f4cd85d66743, identifier: HB45776
2026-03-30 12:22:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92766626-98ba-51ef-ab9c-f4cd85d66743 with identifier: HB45776
2026-03-30 12:22:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92766626-98ba-51ef-ab9c-f4cd85d66743 with identifier: HB45776
2026-03-30 12:22:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92766626-98ba-51ef-ab9c-f4cd85d66743 with identifier: HB45776 to the API
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB45776>
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:32:30Z',
'fuel_type': 'diesel',
'id': '92766626-98ba-51ef-ab9c-f4cd85d66743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB45776',
'listing': 'auction',
'location': 'IT',
'make': 'Audi',
'model': 'Q5',
'odometer': 15913,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_468b1b54b58a1df26237bbf2bb60d87a.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_a0051bc94d4fcc79c4809e5834b56763.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_e4d28ffbcc5a285aeb9d404e1cbf20cd.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_ddaa7468564428f287e3ad6fc25f7138.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_f37b607619c8eac207f2863ed7586245.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1b87989692bc4dee1d9ed9a259ef8582.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_69a776e98c71c20875b20834d12e8a39.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_d2f3973c32577a9a0aa5a344ee2500d4.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_555e703cd577579ab07c291ee8a2b546.jpg',
'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1a5e6e7cb863180f416f49a69217535a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_468b1b54b58a1df26237bbf2bb60d87a.jpg',
'Width': 741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_a0051bc94d4fcc79c4809e5834b56763.jpg',
'Width': 741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_e4d28ffbcc5a285aeb9d404e1cbf20cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_ddaa7468564428f287e3ad6fc25f7138.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_f37b607619c8eac207f2863ed7586245.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1b87989692bc4dee1d9ed9a259ef8582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_69a776e98c71c20875b20834d12e8a39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_d2f3973c32577a9a0aa5a344ee2500d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97789,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_555e703cd577579ab07c291ee8a2b546.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92766626-98ba-51ef-ab9c-f4cd85d66743/92766626-98ba-51ef-ab9c-f4cd85d66743_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/79/59791b3437a65d67a6d0cacf0670a5ee/pa/HB45776_1a5e6e7cb863180f416f49a69217535a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB45776%27 HTTP/1.1" 200 None
2026-03-30 12:22:34 [auto1.it] INFO: Saving data for HB45776: {'created_time': 1774873354.688001, 'last_price_update_time': 1774873354.688013, 'auction_closing_time': 1774971150.0}
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB45776') HTTP/1.1" 204 0
2026-03-30 12:22:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.287(s), this was the 2nd time calling it.
2026-03-30 12:22:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.232184544144204 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:22:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL76635> (referer: https://www.auto1.com/v1/car-details-view/DL76635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 403f8173-5813-50c6-82d3-5c3a27f36406 with identifier: DL76635
2026-03-30 12:22:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 403f8173-5813-50c6-82d3-5c3a27f36406 with scrape type 1
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 403f8173-5813-50c6-82d3-5c3a27f36406
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_83ab9e548cc944172f250c812da8fcf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_83ab9e548cc944172f250c812da8fcf0.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_ded00dac8d1b968062412bf62212e6fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_ded00dac8d1b968062412bf62212e6fc.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_1a635b0957f33e63287a61890826ad1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_1a635b0957f33e63287a61890826ad1c.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_d8d66ff31cd5ab2bbddbdb87c3c41672.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_d8d66ff31cd5ab2bbddbdb87c3c41672.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_5e67a62bdb260b66d4bd56c64ae3db0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5e67a62bdb260b66d4bd56c64ae3db0e.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_2f01f89ac73e6ea97e8f242ab930fb13.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2f01f89ac73e6ea97e8f242ab930fb13.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_2518f124c70b5e2ebffa7fa2d9280c14.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2518f124c70b5e2ebffa7fa2d9280c14.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_5977ad53c773ffdd56c03f0b3b6e2fbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5977ad53c773ffdd56c03f0b3b6e2fbf.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_29dc108a096fba0559a81ad621b118ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_29dc108a096fba0559a81ad621b118ae.jpg already downloaded
2026-03-30 12:22:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F90%252F43908bc9a2f69b8a5ae1b46b0314aeb4%252Fpa%252FDL76635_946d9cb2b0cd4d461c49ccf6214a906e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_946d9cb2b0cd4d461c49ccf6214a906e.jpg already downloaded
2026-03-30 12:22:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 403f8173-5813-50c6-82d3-5c3a27f36406, identifier: DL76635
2026-03-30 12:22:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 403f8173-5813-50c6-82d3-5c3a27f36406 with identifier: DL76635
2026-03-30 12:22:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 403f8173-5813-50c6-82d3-5c3a27f36406 with identifier: DL76635
2026-03-30 12:22:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 403f8173-5813-50c6-82d3-5c3a27f36406 with identifier: DL76635 to the API
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL76635>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:00:54Z',
'fuel_type': 'diesel',
'id': '403f8173-5813-50c6-82d3-5c3a27f36406',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL76635',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 180455,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_83ab9e548cc944172f250c812da8fcf0.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_ded00dac8d1b968062412bf62212e6fc.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_1a635b0957f33e63287a61890826ad1c.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_d8d66ff31cd5ab2bbddbdb87c3c41672.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5e67a62bdb260b66d4bd56c64ae3db0e.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2f01f89ac73e6ea97e8f242ab930fb13.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2518f124c70b5e2ebffa7fa2d9280c14.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5977ad53c773ffdd56c03f0b3b6e2fbf.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_29dc108a096fba0559a81ad621b118ae.jpg',
'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_946d9cb2b0cd4d461c49ccf6214a906e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_83ab9e548cc944172f250c812da8fcf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_ded00dac8d1b968062412bf62212e6fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_1a635b0957f33e63287a61890826ad1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_d8d66ff31cd5ab2bbddbdb87c3c41672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5e67a62bdb260b66d4bd56c64ae3db0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2f01f89ac73e6ea97e8f242ab930fb13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_2518f124c70b5e2ebffa7fa2d9280c14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_5977ad53c773ffdd56c03f0b3b6e2fbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_29dc108a096fba0559a81ad621b118ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_403f8173-5813-50c6-82d3-5c3a27f36406/403f8173-5813-50c6-82d3-5c3a27f36406_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/90/43908bc9a2f69b8a5ae1b46b0314aeb4/pa/DL76635_946d9cb2b0cd4d461c49ccf6214a906e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL76635%27 HTTP/1.1" 200 None
2026-03-30 12:22:45 [auto1.it] INFO: Saving data for DL76635: {'created_time': 1774873365.965919, 'last_price_update_time': 1774873365.96593, 'auction_closing_time': 1774969254.0}
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL76635') HTTP/1.1" 204 0
2026-03-30 12:22:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY03652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM78765> (referer: https://www.auto1.com/v1/car-details-view/RM78765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a306a124-8457-5a2a-83e8-169e2d376d76 with identifier: RM78765
2026-03-30 12:22:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a306a124-8457-5a2a-83e8-169e2d376d76 with scrape type 1
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a306a124-8457-5a2a-83e8-169e2d376d76
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_413bae7eed3f1b39044f1ebf36483c48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_413bae7eed3f1b39044f1ebf36483c48.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_8633b84d2bc2630dc98149a3831a0de0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_8633b84d2bc2630dc98149a3831a0de0.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_1195ee6ba053d53c2e6ab5634b81d737.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_1195ee6ba053d53c2e6ab5634b81d737.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_5cee9e944c157a1b3539326191e4b3df.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5cee9e944c157a1b3539326191e4b3df.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_863b729df3af4d5954c2c9402bab2818.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_863b729df3af4d5954c2c9402bab2818.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_0515cac1af5e7ddc00afc1c08f499fc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_0515cac1af5e7ddc00afc1c08f499fc2.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_c5b5ae18ce9d29d1afdf71be43ea450f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c5b5ae18ce9d29d1afdf71be43ea450f.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_5bf39ca9b7b318f4b090f0733fd274ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5bf39ca9b7b318f4b090f0733fd274ab.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_bf30c6ecf2ca7d6d35709d6b96b55fff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_bf30c6ecf2ca7d6d35709d6b96b55fff.jpg already downloaded
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fb7%252F45b7422c2eebe40fb0ae37c2fb116ebc%252Fpa%252FRM78765_c871492e0a3773ddddd772b623d100ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c871492e0a3773ddddd772b623d100ca.jpg already downloaded
2026-03-30 12:22:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a306a124-8457-5a2a-83e8-169e2d376d76, identifier: RM78765
2026-03-30 12:22:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a306a124-8457-5a2a-83e8-169e2d376d76 with identifier: RM78765
2026-03-30 12:22:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a306a124-8457-5a2a-83e8-169e2d376d76 with identifier: RM78765
2026-03-30 12:22:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a306a124-8457-5a2a-83e8-169e2d376d76 with identifier: RM78765 to the API
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:22:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM78765>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:22:49Z',
'fuel_type': 'diesel',
'id': 'a306a124-8457-5a2a-83e8-169e2d376d76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM78765',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'BMW',
'model': 'X3',
'odometer': 205752,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_413bae7eed3f1b39044f1ebf36483c48.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_8633b84d2bc2630dc98149a3831a0de0.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_1195ee6ba053d53c2e6ab5634b81d737.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5cee9e944c157a1b3539326191e4b3df.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_863b729df3af4d5954c2c9402bab2818.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_0515cac1af5e7ddc00afc1c08f499fc2.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c5b5ae18ce9d29d1afdf71be43ea450f.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5bf39ca9b7b318f4b090f0733fd274ab.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_bf30c6ecf2ca7d6d35709d6b96b55fff.jpg',
'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c871492e0a3773ddddd772b623d100ca.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_413bae7eed3f1b39044f1ebf36483c48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_8633b84d2bc2630dc98149a3831a0de0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_1195ee6ba053d53c2e6ab5634b81d737.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5cee9e944c157a1b3539326191e4b3df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_863b729df3af4d5954c2c9402bab2818.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_0515cac1af5e7ddc00afc1c08f499fc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c5b5ae18ce9d29d1afdf71be43ea450f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_5bf39ca9b7b318f4b090f0733fd274ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_bf30c6ecf2ca7d6d35709d6b96b55fff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a306a124-8457-5a2a-83e8-169e2d376d76/a306a124-8457-5a2a-83e8-169e2d376d76_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img45/b7/45b7422c2eebe40fb0ae37c2fb116ebc/pa/RM78765_c871492e0a3773ddddd772b623d100ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-08-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM78765%27 HTTP/1.1" 200 None
2026-03-30 12:22:50 [auto1.it] INFO: Saving data for RM78765: {'created_time': 1774873370.795071, 'last_price_update_time': 1774873370.795088, 'auction_closing_time': 1774970569.0}
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM78765') HTTP/1.1" 204 0
2026-03-30 12:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS34507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:22:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD19752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:22:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC73046> (referer: https://www.auto1.com/v1/car-details-view/YC73046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cddd03b-6270-5675-9c88-9f75ee47a18e with identifier: YC73046
2026-03-30 12:23:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cddd03b-6270-5675-9c88-9f75ee47a18e with scrape type 1
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9cddd03b-6270-5675-9c88-9f75ee47a18e
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_40b00347b039a4ac44b1567693104c01.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_40b00347b039a4ac44b1567693104c01.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_54c04773b8e984f6eea0ea0c952489c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_54c04773b8e984f6eea0ea0c952489c0.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_55ecb63f6b8cab12e35f9468b70315cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_55ecb63f6b8cab12e35f9468b70315cf.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_7fde33066c2db68abe5f492ce4cf07c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_7fde33066c2db68abe5f492ce4cf07c7.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_6a58abd23ff9e685de7d05594086a656.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_6a58abd23ff9e685de7d05594086a656.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_a40e5c3de589999903b5bc2cf02850ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_a40e5c3de589999903b5bc2cf02850ff.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_e2d1859b68bf99c82d178117094e92f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_e2d1859b68bf99c82d178117094e92f8.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_59f9683b7da97aeb3c48a5e659e02e67.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_59f9683b7da97aeb3c48a5e659e02e67.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_19b3d29f967ed04a27fe38706f77b60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_19b3d29f967ed04a27fe38706f77b60b.jpg already downloaded
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F6d%252Fbd6d606ac5b0ef61904fe8e8a1981731%252Fpa%252FYC73046_34971d8296e6f3e1292e7ae47be5685a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_34971d8296e6f3e1292e7ae47be5685a.jpg already downloaded
2026-03-30 12:23:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9cddd03b-6270-5675-9c88-9f75ee47a18e, identifier: YC73046
2026-03-30 12:23:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9cddd03b-6270-5675-9c88-9f75ee47a18e with identifier: YC73046
2026-03-30 12:23:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9cddd03b-6270-5675-9c88-9f75ee47a18e with identifier: YC73046
2026-03-30 12:23:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9cddd03b-6270-5675-9c88-9f75ee47a18e with identifier: YC73046 to the API
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC73046>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:40:35Z',
'fuel_type': 'diesel',
'id': '9cddd03b-6270-5675-9c88-9f75ee47a18e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC73046',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 194454,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_40b00347b039a4ac44b1567693104c01.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_54c04773b8e984f6eea0ea0c952489c0.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_55ecb63f6b8cab12e35f9468b70315cf.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_7fde33066c2db68abe5f492ce4cf07c7.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_6a58abd23ff9e685de7d05594086a656.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_a40e5c3de589999903b5bc2cf02850ff.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_e2d1859b68bf99c82d178117094e92f8.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_59f9683b7da97aeb3c48a5e659e02e67.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_19b3d29f967ed04a27fe38706f77b60b.jpg',
'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_34971d8296e6f3e1292e7ae47be5685a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_40b00347b039a4ac44b1567693104c01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_54c04773b8e984f6eea0ea0c952489c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_55ecb63f6b8cab12e35f9468b70315cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_7fde33066c2db68abe5f492ce4cf07c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_6a58abd23ff9e685de7d05594086a656.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_a40e5c3de589999903b5bc2cf02850ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_e2d1859b68bf99c82d178117094e92f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_59f9683b7da97aeb3c48a5e659e02e67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_19b3d29f967ed04a27fe38706f77b60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cddd03b-6270-5675-9c88-9f75ee47a18e/9cddd03b-6270-5675-9c88-9f75ee47a18e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/6d/bd6d606ac5b0ef61904fe8e8a1981731/pa/YC73046_34971d8296e6f3e1292e7ae47be5685a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2014}
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC73046%27 HTTP/1.1" 200 None
2026-03-30 12:23:02 [auto1.it] INFO: Saving data for YC73046: {'created_time': 1774873382.894806, 'last_price_update_time': 1774873382.894819, 'auction_closing_time': 1774971635.0}
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC73046') HTTP/1.1" 204 0
2026-03-30 12:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:04 [scrapy.extensions.logstats] INFO: Crawled 115 pages (at 9 pages/min), scraped 69 items (at 4 items/min)
2026-03-30 12:23:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:23:04 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3582 | hits on page: 40
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: JB82586
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB82586%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.it] INFO: Scrape type for JB82586: 0
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: EK06543
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: DR88272
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: XU36163
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: TW74666
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: UE40276
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: FD98463
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD98463%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.it] INFO: Scrape type for FD98463: 2
2026-03-30 12:23:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 432a143f-11ab-5264-9b1b-0ac9047bbccb with identifier: FD98463
2026-03-30 12:23:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432a143f-11ab-5264-9b1b-0ac9047bbccb with scrape type 2
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 432a143f-11ab-5264-9b1b-0ac9047bbccb with scrape type 2
2026-03-30 12:23:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 432a143f-11ab-5264-9b1b-0ac9047bbccb, identifier: FD98463
2026-03-30 12:23:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 432a143f-11ab-5264-9b1b-0ac9047bbccb with identifier: FD98463
2026-03-30 12:23:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 432a143f-11ab-5264-9b1b-0ac9047bbccb with identifier: FD98463
2026-03-30 12:23:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 432a143f-11ab-5264-9b1b-0ac9047bbccb with identifier: FD98463 to the API
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-31T15:07:28Z',
'fuel_type': 'petrol',
'id': '432a143f-11ab-5264-9b1b-0ac9047bbccb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD98463',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Velar',
'odometer': 167247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-10',
'seller_name': None,
'title': 'Land Rover Range Rover Velar 2.0 Turbo',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD98463%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.it] INFO: Saving data for FD98463: {'auction_closing_time': 1774969648.0, 'created_time': 1772626699.02079, 'last_price_update_time': 1774873384.738762}
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FD98463') HTTP/1.1" 204 0
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: NW46115
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: GF50602
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF50602%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.it] INFO: Scrape type for GF50602: 1
2026-03-30 12:23:04 [auto1.it] INFO: Found listing with ID: BL53614
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL53614%27 HTTP/1.1" 200 None
2026-03-30 12:23:04 [auto1.it] INFO: Scrape type for BL53614: 2
2026-03-30 12:23:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c070626e-c6ab-565e-8a8e-517a27b4ce75 with identifier: BL53614
2026-03-30 12:23:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c070626e-c6ab-565e-8a8e-517a27b4ce75 with scrape type 2
2026-03-30 12:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c070626e-c6ab-565e-8a8e-517a27b4ce75 with scrape type 2
2026-03-30 12:23:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c070626e-c6ab-565e-8a8e-517a27b4ce75, identifier: BL53614
2026-03-30 12:23:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c070626e-c6ab-565e-8a8e-517a27b4ce75 with identifier: BL53614
2026-03-30 12:23:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c070626e-c6ab-565e-8a8e-517a27b4ce75 with identifier: BL53614
2026-03-30 12:23:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c070626e-c6ab-565e-8a8e-517a27b4ce75 with identifier: BL53614 to the API
2026-03-30 12:23:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:59:21Z',
'fuel_type': 'petrol',
'id': 'c070626e-c6ab-565e-8a8e-517a27b4ce75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL53614',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 107002,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Cross',
'transmission': 'manual',
'trim': 'Cross',
'year': 2017}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL53614%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Saving data for BL53614: {'auction_closing_time': 1774972761.0, 'created_time': 1774526761.787651, 'last_price_update_time': 1774873385.254297}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL53614') HTTP/1.1" 204 0
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: BR16136
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: AU75804
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: TY21344
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: DY54312
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY54312%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for DY54312: 2
2026-03-30 12:23:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a727d9-85de-5135-989d-48417ee21de6 with identifier: DY54312
2026-03-30 12:23:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a727d9-85de-5135-989d-48417ee21de6 with scrape type 2
2026-03-30 12:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22a727d9-85de-5135-989d-48417ee21de6 with scrape type 2
2026-03-30 12:23:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22a727d9-85de-5135-989d-48417ee21de6, identifier: DY54312
2026-03-30 12:23:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22a727d9-85de-5135-989d-48417ee21de6 with identifier: DY54312
2026-03-30 12:23:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22a727d9-85de-5135-989d-48417ee21de6 with identifier: DY54312
2026-03-30 12:23:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22a727d9-85de-5135-989d-48417ee21de6 with identifier: DY54312 to the API
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:13Z',
'fuel_type': 'diesel',
'id': '22a727d9-85de-5135-989d-48417ee21de6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY54312',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 223589,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-03',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY54312%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Saving data for DY54312: {'auction_closing_time': 1774970533.0, 'created_time': 1774447581.407878, 'last_price_update_time': 1774873385.753067}
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY54312') HTTP/1.1" 204 0
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: DP40567
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: ZZ81655
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ81655%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for ZZ81655: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: ES43823
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: DU27150
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: EL89401
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL89401%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for EL89401: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: DP37147
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP37147%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for DP37147: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: YV57327
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV57327%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for YV57327: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: TY83482
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: HB41504
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB41504%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for HB41504: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: CK93665
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: TR33075
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR33075%27 HTTP/1.1" 200 None
2026-03-30 12:23:05 [auto1.it] INFO: Scrape type for TR33075: 1
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: NL85591
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: JB14209
2026-03-30 12:23:05 [auto1.it] INFO: Found listing with ID: DU55217
2026-03-30 12:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU55217%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Scrape type for DU55217: 1
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: XE42433
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE42433%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Scrape type for XE42433: 2
2026-03-30 12:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee99c8c-5f6f-5d3e-848a-dd42df790f8c with identifier: XE42433
2026-03-30 12:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee99c8c-5f6f-5d3e-848a-dd42df790f8c with scrape type 2
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee99c8c-5f6f-5d3e-848a-dd42df790f8c with scrape type 2
2026-03-30 12:23:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cee99c8c-5f6f-5d3e-848a-dd42df790f8c, identifier: XE42433
2026-03-30 12:23:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cee99c8c-5f6f-5d3e-848a-dd42df790f8c with identifier: XE42433
2026-03-30 12:23:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cee99c8c-5f6f-5d3e-848a-dd42df790f8c with identifier: XE42433
2026-03-30 12:23:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cee99c8c-5f6f-5d3e-848a-dd42df790f8c with identifier: XE42433 to the API
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:12:18Z',
'fuel_type': 'diesel',
'id': 'cee99c8c-5f6f-5d3e-848a-dd42df790f8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE42433',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 237977,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-17',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Platinum',
'transmission': 'automatic',
'trim': 'Platinum',
'year': 2010}
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE42433%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Saving data for XE42433: {'auction_closing_time': 1774969938.0, 'created_time': 1772627340.588943, 'last_price_update_time': 1774873386.544189}
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE42433') HTTP/1.1" 204 0
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: NN08161
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN08161%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Scrape type for NN08161: 1
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: JA22796
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA22796%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Scrape type for JA22796: 1
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: TP38314
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: AU49337
2026-03-30 12:23:06 [auto1.it] INFO: Found listing with ID: VM26372
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM26372%27 HTTP/1.1" 200 None
2026-03-30 12:23:06 [auto1.it] INFO: Scrape type for VM26372: 2
2026-03-30 12:23:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dadd0d25-4c76-5c27-8639-0565c01f88d1 with identifier: VM26372
2026-03-30 12:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dadd0d25-4c76-5c27-8639-0565c01f88d1 with scrape type 2
2026-03-30 12:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dadd0d25-4c76-5c27-8639-0565c01f88d1 with scrape type 2
2026-03-30 12:23:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dadd0d25-4c76-5c27-8639-0565c01f88d1, identifier: VM26372
2026-03-30 12:23:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dadd0d25-4c76-5c27-8639-0565c01f88d1 with identifier: VM26372
2026-03-30 12:23:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dadd0d25-4c76-5c27-8639-0565c01f88d1 with identifier: VM26372
2026-03-30 12:23:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dadd0d25-4c76-5c27-8639-0565c01f88d1 with identifier: VM26372 to the API
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:12:24Z',
'fuel_type': 'diesel',
'id': 'dadd0d25-4c76-5c27-8639-0565c01f88d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM26372',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 168795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-08',
'seller_name': None,
'title': 'Toyota Auris 1.4 Turbodiesel Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM26372%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Saving data for VM26372: {'auction_closing_time': 1774969944.0, 'created_time': 1772223688.001993, 'last_price_update_time': 1774873387.270833}
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM26372') HTTP/1.1" 204 0
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: BF48403
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF48403%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Scrape type for BF48403: 1
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: CH99714
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH99714%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Scrape type for CH99714: 1
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: VG49733
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG49733%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Scrape type for VG49733: 1
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: EU37885
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU37885%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Scrape type for EU37885: 1
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: TD04109
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04109%27 HTTP/1.1" 200 None
2026-03-30 12:23:07 [auto1.it] INFO: Scrape type for TD04109: 1
2026-03-30 12:23:07 [auto1.it] INFO: Found listing with ID: JU97705
2026-03-30 12:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU36225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR88272> (referer: https://www.auto1.com/v1/car-details-view/DR88272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with identifier: DR88272
2026-03-30 12:23:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with scrape type 1
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_a25e78543f8362294031dfa5013110cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_a25e78543f8362294031dfa5013110cf.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_8da2ae7d380decf942f09d3748a79b56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8da2ae7d380decf942f09d3748a79b56.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_164082e39706ab782177943387bf9cfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_164082e39706ab782177943387bf9cfd.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_252977c0c3dc066d87596266d2e4a96c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_252977c0c3dc066d87596266d2e4a96c.jpg not downloaded yet
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_59f782d8a81d2f9e8b417153f2488e75.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_59f782d8a81d2f9e8b417153f2488e75.jpg not downloaded yet
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.788(s), this was the 1st time calling it.
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.399432067909839 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF51133> (referer: https://www.auto1.com/v1/car-details-view/RF51133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3ed455-5641-53cf-b0ca-67846f0b1e75 with identifier: RF51133
2026-03-30 12:23:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3ed455-5641-53cf-b0ca-67846f0b1e75 with scrape type 1
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg not downloaded yet
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg not downloaded yet
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_8f516175a436d540e4b9a15e0dfaed18.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_8f516175a436d540e4b9a15e0dfaed18.jpg not downloaded yet
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_b45b7357690af85a5df275a33b821a32.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_b45b7357690af85a5df275a33b821a32.jpg not downloaded yet
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_eff9a865907a2935760cb9f5ab798716.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_eff9a865907a2935760cb9f5ab798716.jpg not downloaded yet
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg not downloaded yet
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg not downloaded yet
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg not downloaded yet
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_133392058042ded197bf4adab568bc81.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_133392058042ded197bf4adab568bc81.jpg not downloaded yet
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg not downloaded yet
2026-03-30 12:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_59f782d8a81d2f9e8b417153f2488e75.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f54910>
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_59f782d8a81d2f9e8b417153f2488e75.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_59f782d8a81d2f9e8b417153f2488e75.jpg saved to cache
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f4b1d0>
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg saved to cache
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_133392058042ded197bf4adab568bc81.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd5250>
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_133392058042ded197bf4adab568bc81.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_133392058042ded197bf4adab568bc81.jpg saved to cache
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a3af50>
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg saved to cache
2026-03-30 12:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd82d0>
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg saved to cache
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010940fd0>
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg saved to cache
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_eff9a865907a2935760cb9f5ab798716.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a95410>
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_eff9a865907a2935760cb9f5ab798716.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_eff9a865907a2935760cb9f5ab798716.jpg saved to cache
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_b45b7357690af85a5df275a33b821a32.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a3a910>
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_b45b7357690af85a5df275a33b821a32.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_b45b7357690af85a5df275a33b821a32.jpg saved to cache
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_8f516175a436d540e4b9a15e0dfaed18.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.534(s), this was the 1st time calling it.
2026-03-30 12:23:18 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.396006963590156 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601172dd50>
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_8f516175a436d540e4b9a15e0dfaed18.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_8f516175a436d540e4b9a15e0dfaed18.jpg saved to cache
2026-03-30 12:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2d390>
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg saved to cache
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b18fd0>
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb2%252F7ab2e806e7f179b83734b70174c44df1%252Fpa%252FRF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg saved to cache
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd3ed455-5641-53cf-b0ca-67846f0b1e75
2026-03-30 12:23:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd3ed455-5641-53cf-b0ca-67846f0b1e75, skipping ID generation
2026-03-30 12:23:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3ed455-5641-53cf-b0ca-67846f0b1e75 with scrape type 1
2026-03-30 12:23:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd3ed455-5641-53cf-b0ca-67846f0b1e75 sending to next pipeline
2026-03-30 12:23:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd3ed455-5641-53cf-b0ca-67846f0b1e75, identifier: RF51133
2026-03-30 12:23:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd3ed455-5641-53cf-b0ca-67846f0b1e75 with identifier: RF51133
2026-03-30 12:23:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd3ed455-5641-53cf-b0ca-67846f0b1e75 with identifier: RF51133
2026-03-30 12:23:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd3ed455-5641-53cf-b0ca-67846f0b1e75 with identifier: RF51133 to the API
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:21:49Z',
'fuel_type': 'diesel',
'id': 'dd3ed455-5641-53cf-b0ca-67846f0b1e75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF51133',
'listing': 'auction',
'location': 'IT, MILANO',
'make': 'Volvo',
'model': 'XC60',
'odometer': 241290,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_25085c6dbdbfe3ce6593d204b95905bc.jpg',
'Width': 748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1846f65d6306c30f09c6cdebe19e2ee2.jpg',
'Width': 748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90080,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_8f516175a436d540e4b9a15e0dfaed18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_b45b7357690af85a5df275a33b821a32.jpg',
'Width': 496},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_eff9a865907a2935760cb9f5ab798716.jpg',
'Width': 674},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_caaaaa46e1165afcbd1e642ec3ab3696.jpg',
'Width': 771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96508,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_1f9e60b11f2adcdad95a962aa5f8b826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97865,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_ffc2151fa3994286f4cb1cefb2a5465a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76017,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_133392058042ded197bf4adab568bc81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3ed455-5641-53cf-b0ca-67846f0b1e75/dd3ed455-5641-53cf-b0ca-67846f0b1e75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73463,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img7a/b2/7ab2e806e7f179b83734b70174c44df1/pa/RF51133_975c2ffa10cfb84b8e419cd024957f0c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Ocean Race 2WD',
'transmission': 'automatic',
'trim': 'Ocean Race 2WD',
'year': 2016}
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF51133%27 HTTP/1.1" 200 None
2026-03-30 12:23:19 [auto1.it] INFO: Saving data for RF51133: {'created_time': 1774873399.783129, 'last_price_update_time': 1774873399.783143, 'auction_closing_time': 1774970509.0}
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF51133') HTTP/1.1" 204 0
2026-03-30 12:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_252977c0c3dc066d87596266d2e4a96c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a562d0>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_252977c0c3dc066d87596266d2e4a96c.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_252977c0c3dc066d87596266d2e4a96c.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_164082e39706ab782177943387bf9cfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f84c90>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_164082e39706ab782177943387bf9cfd.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_164082e39706ab782177943387bf9cfd.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8da2ae7d380decf942f09d3748a79b56.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e99210>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_8da2ae7d380decf942f09d3748a79b56.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8da2ae7d380decf942f09d3748a79b56.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fdaf10>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e3f10>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.762(s), this was the 1st time calling it.
2026-03-30 12:23:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.551313062531374 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010942c50>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg saved to cache
2026-03-30 12:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6bed0>
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg saved to cache
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_a25e78543f8362294031dfa5013110cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f4bfd0>
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg saved to cache
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd69d0>
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252Fb2%252F54b2adbef996407faf2bcd4fb2af20ff%252Fpa%252FDR88272_a25e78543f8362294031dfa5013110cf.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_a25e78543f8362294031dfa5013110cf.jpg saved to cache
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f
2026-03-30 12:23:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f, skipping ID generation
2026-03-30 12:23:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with scrape type 1
2026-03-30 12:23:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1fc56af-e730-5e02-a812-d4c5b0bcdd7f sending to next pipeline
2026-03-30 12:23:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f, identifier: DR88272
2026-03-30 12:23:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with identifier: DR88272
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 12:23:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:23:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with identifier: DR88272
2026-03-30 12:23:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1fc56af-e730-5e02-a812-d4c5b0bcdd7f with identifier: DR88272 to the API
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_a25e78543f8362294031dfa5013110cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 4,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine': '',
'engine_horse_power': 118,
'expiration_date': '2026-03-31T15:23:16Z',
'fuel_type': 'electro',
'id': 'd1fc56af-e730-5e02-a812-d4c5b0bcdd7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR88272',
'listing': 'auction',
'location': 'IT, Casoria',
'make': 'Fiat',
'model': '500e',
'odometer': 19933,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_a25e78543f8362294031dfa5013110cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8c61ce3f73a00de7943b1ac3d51da104.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_bf38ccdfb2a14a6a29dd4280e62e35b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_ce6f0c6fbc0fe4c0d26999e03b4d731d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_192f5d7e2f9170d16e35a488c3d1023f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_d4cc138fadb36b3ebef6c66df44bfd2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_8da2ae7d380decf942f09d3748a79b56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_164082e39706ab782177943387bf9cfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_252977c0c3dc066d87596266d2e4a96c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1fc56af-e730-5e02-a812-d4c5b0bcdd7f/d1fc56af-e730-5e02-a812-d4c5b0bcdd7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/b2/54b2adbef996407faf2bcd4fb2af20ff/pa/DR88272_59f782d8a81d2f9e8b417153f2488e75.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-07',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500e electric drive 87 kW Icon',
'transmission': 'automatic',
'trim': 'Icon',
'year': 2021}
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR88272%27 HTTP/1.1" 200 None
2026-03-30 12:23:22 [auto1.it] INFO: Saving data for DR88272: {'created_time': 1774873402.072177, 'last_price_update_time': 1774873402.072188, 'auction_closing_time': 1774970596.0}
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DR88272') HTTP/1.1" 204 0
2026-03-30 12:23:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX28669> (referer: https://www.auto1.com/v1/car-details-view/RX28669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b3402e-30c2-50b5-a399-6ddbc09c75fc with identifier: RX28669
2026-03-30 12:23:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc with scrape type 1
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_1bd85e196a4c9a8e4203539e501165cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1bd85e196a4c9a8e4203539e501165cf.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_c93daae1111215bbd58e91793c39bd24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_c93daae1111215bbd58e91793c39bd24.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_9e0e372f27b20768b1feb29700fbb769.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9e0e372f27b20768b1feb29700fbb769.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_f8660513337f6c074933974658851344.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_f8660513337f6c074933974658851344.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_ad62e8467d8c4de438b4b8230b152401.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_ad62e8467d8c4de438b4b8230b152401.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_2c95219e1f14603b6a646df3935cae98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_2c95219e1f14603b6a646df3935cae98.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg not downloaded yet
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_9b269c2122f9b1a25a88512415305607.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9b269c2122f9b1a25a88512415305607.jpg not downloaded yet
2026-03-30 12:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS49157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9b269c2122f9b1a25a88512415305607.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f49bd0>
2026-03-30 12:23:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_9b269c2122f9b1a25a88512415305607.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9b269c2122f9b1a25a88512415305607.jpg saved to cache
2026-03-30 12:23:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.606(s), this was the 1st time calling it.
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.181125859646943 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY03652> (referer: https://www.auto1.com/v1/car-details-view/VY03652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae23390e-de9c-513a-a319-46114f58a43c with identifier: VY03652
2026-03-30 12:23:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae23390e-de9c-513a-a319-46114f58a43c with scrape type 1
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_883c027e5a59e619d5cc7c8a50cee495.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_883c027e5a59e619d5cc7c8a50cee495.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_64cce4522729112fe8061e66468afdb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_64cce4522729112fe8061e66468afdb9.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_36644c0a271a39da21d8f36405fd2feb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_36644c0a271a39da21d8f36405fd2feb.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_a57206e3d5ec88518293211676ffbb57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_a57206e3d5ec88518293211676ffbb57.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_5f2ef8532b048deacd65c001c216e945.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_5f2ef8532b048deacd65c001c216e945.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg not downloaded yet
2026-03-30 12:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_7303fb98e6472e64774b3460d158be42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_7303fb98e6472e64774b3460d158be42.jpg not downloaded yet
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_21f45d068ab3447586e82499f79763a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_21f45d068ab3447586e82499f79763a8.jpg not downloaded yet
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd6910>
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg saved to cache
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010902310>
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg saved to cache
2026-03-30 12:23:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_21f45d068ab3447586e82499f79763a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa7010>
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_21f45d068ab3447586e82499f79763a8.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_21f45d068ab3447586e82499f79763a8.jpg saved to cache
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_7303fb98e6472e64774b3460d158be42.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003faa990>
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_7303fb98e6472e64774b3460d158be42.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_7303fb98e6472e64774b3460d158be42.jpg saved to cache
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_5f2ef8532b048deacd65c001c216e945.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e0790>
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_5f2ef8532b048deacd65c001c216e945.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_5f2ef8532b048deacd65c001c216e945.jpg saved to cache
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_a57206e3d5ec88518293211676ffbb57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a42e50>
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_a57206e3d5ec88518293211676ffbb57.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_a57206e3d5ec88518293211676ffbb57.jpg saved to cache
2026-03-30 12:23:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_36644c0a271a39da21d8f36405fd2feb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b19d10>
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_36644c0a271a39da21d8f36405fd2feb.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_36644c0a271a39da21d8f36405fd2feb.jpg saved to cache
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f86890>
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg saved to cache
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_64cce4522729112fe8061e66468afdb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8dd50>
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_64cce4522729112fe8061e66468afdb9.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_64cce4522729112fe8061e66468afdb9.jpg saved to cache
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f85950>
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg saved to cache
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_883c027e5a59e619d5cc7c8a50cee495.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091d710>
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F38%252Fa0389c89d480d4680554d38632c9d4eb%252Fpa%252FVY03652_883c027e5a59e619d5cc7c8a50cee495.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_883c027e5a59e619d5cc7c8a50cee495.jpg saved to cache
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae23390e-de9c-513a-a319-46114f58a43c
2026-03-30 12:23:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae23390e-de9c-513a-a319-46114f58a43c, skipping ID generation
2026-03-30 12:23:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae23390e-de9c-513a-a319-46114f58a43c with scrape type 1
2026-03-30 12:23:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae23390e-de9c-513a-a319-46114f58a43c sending to next pipeline
2026-03-30 12:23:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae23390e-de9c-513a-a319-46114f58a43c, identifier: VY03652
2026-03-30 12:23:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae23390e-de9c-513a-a319-46114f58a43c with identifier: VY03652
2026-03-30 12:23:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae23390e-de9c-513a-a319-46114f58a43c with identifier: VY03652
2026-03-30 12:23:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae23390e-de9c-513a-a319-46114f58a43c with identifier: VY03652 to the API
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_883c027e5a59e619d5cc7c8a50cee495.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:03:45Z',
'fuel_type': 'diesel',
'id': 'ae23390e-de9c-513a-a319-46114f58a43c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY03652',
'listing': 'auction',
'location': 'IT, SALERNO',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 38556,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_883c027e5a59e619d5cc7c8a50cee495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_c5a3e1379371219e9acd8a90b8c70fdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_64cce4522729112fe8061e66468afdb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_e3204ebb6f4cca00eeda752a3f55ace2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_36644c0a271a39da21d8f36405fd2feb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_a57206e3d5ec88518293211676ffbb57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_5f2ef8532b048deacd65c001c216e945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_fbb7ddab8111c4f0f1d1156ab0eaf41d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_7303fb98e6472e64774b3460d158be42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae23390e-de9c-513a-a319-46114f58a43c/ae23390e-de9c-513a-a319-46114f58a43c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/38/a0389c89d480d4680554d38632c9d4eb/pa/VY03652_21f45d068ab3447586e82499f79763a8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi XTech 2WD',
'transmission': 'manual',
'trim': 'XTech 2WD',
'year': 2023}
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY03652%27 HTTP/1.1" 200 None
2026-03-30 12:23:34 [auto1.it] INFO: Saving data for VY03652: {'created_time': 1774873414.805489, 'last_price_update_time': 1774873414.805502, 'auction_closing_time': 1774969425.0}
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY03652') HTTP/1.1" 204 0
2026-03-30 12:23:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010901d10>
2026-03-30 12:23:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg saved to cache
2026-03-30 12:23:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2e5d0>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg saved to cache
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_2c95219e1f14603b6a646df3935cae98.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010902350>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_2c95219e1f14603b6a646df3935cae98.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_2c95219e1f14603b6a646df3935cae98.jpg saved to cache
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_ad62e8467d8c4de438b4b8230b152401.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ea8e10>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_ad62e8467d8c4de438b4b8230b152401.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_ad62e8467d8c4de438b4b8230b152401.jpg saved to cache
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_f8660513337f6c074933974658851344.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a393d0>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_f8660513337f6c074933974658851344.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_f8660513337f6c074933974658851344.jpg saved to cache
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9e0e372f27b20768b1feb29700fbb769.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8d050>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_9e0e372f27b20768b1feb29700fbb769.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9e0e372f27b20768b1feb29700fbb769.jpg saved to cache
2026-03-30 12:23:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_c93daae1111215bbd58e91793c39bd24.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1bd85e196a4c9a8e4203539e501165cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f84fd0>
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_c93daae1111215bbd58e91793c39bd24.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_c93daae1111215bbd58e91793c39bd24.jpg saved to cache
2026-03-30 12:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:23:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a416d0>
2026-03-30 12:23:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:23:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F9e%252Fbd9e91a9c76d75e6f69f8ef30c79527e%252Fpa%252FRX28669_1bd85e196a4c9a8e4203539e501165cf.jpg') HTTP/1.1" 204 0
2026-03-30 12:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1bd85e196a4c9a8e4203539e501165cf.jpg saved to cache
2026-03-30 12:23:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc
2026-03-30 12:23:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42b3402e-30c2-50b5-a399-6ddbc09c75fc, skipping ID generation
2026-03-30 12:23:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc with scrape type 1
2026-03-30 12:23:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42b3402e-30c2-50b5-a399-6ddbc09c75fc sending to next pipeline
2026-03-30 12:23:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42b3402e-30c2-50b5-a399-6ddbc09c75fc, identifier: RX28669
2026-03-30 12:23:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42b3402e-30c2-50b5-a399-6ddbc09c75fc with identifier: RX28669
2026-03-30 12:23:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42b3402e-30c2-50b5-a399-6ddbc09c75fc with identifier: RX28669
2026-03-30 12:23:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42b3402e-30c2-50b5-a399-6ddbc09c75fc with identifier: RX28669 to the API
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1bd85e196a4c9a8e4203539e501165cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:47:53Z',
'fuel_type': 'petrol',
'id': '42b3402e-30c2-50b5-a399-6ddbc09c75fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX28669',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Ford',
'model': 'Puma',
'odometer': 2580,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1bd85e196a4c9a8e4203539e501165cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_c93daae1111215bbd58e91793c39bd24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9e0e372f27b20768b1feb29700fbb769.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_f8660513337f6c074933974658851344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_ad62e8467d8c4de438b4b8230b152401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_2c95219e1f14603b6a646df3935cae98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_6b55fd1b69bf2953cf1c11d672bbafd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_1afeadf3e6aa9f81b28b361823eb364d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_0a633ba46a13944c5f6c6ae2381ebec4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42b3402e-30c2-50b5-a399-6ddbc09c75fc/42b3402e-30c2-50b5-a399-6ddbc09c75fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbd/9e/bd9e91a9c76d75e6f69f8ef30c79527e/pa/RX28669_9b269c2122f9b1a25a88512415305607.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2023}
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX28669%27 HTTP/1.1" 200 None
2026-03-30 12:23:36 [auto1.it] INFO: Saving data for RX28669: {'created_time': 1774873416.5254, 'last_price_update_time': 1774873416.525411, 'auction_closing_time': 1774972073.0}
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX28669') HTTP/1.1" 204 0
2026-03-30 12:23:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:23:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW91242/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS34507> (referer: https://www.auto1.com/v1/car-details-view/WS34507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a with identifier: WS34507
2026-03-30 12:23:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a with scrape type 1
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_96d6a447ba835f069c10cff9e02c4239.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96d6a447ba835f069c10cff9e02c4239.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_4947c12ff6f6dc06674f0dd316c4a230.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_4947c12ff6f6dc06674f0dd316c4a230.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_96c2564aca2d7a76aea586de19cb6fdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96c2564aca2d7a76aea586de19cb6fdd.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_497912e10cd443326df82528e993bf3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_497912e10cd443326df82528e993bf3d.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_843c1be87818922936af252270355773.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_843c1be87818922936af252270355773.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_005d1e8099275e507914d0b2a51f5e38.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_005d1e8099275e507914d0b2a51f5e38.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_a976e3854b089a66889f194f1650d0c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_a976e3854b089a66889f194f1650d0c8.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_9d8f77c7d52f4c9782e40166de2a6451.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_9d8f77c7d52f4c9782e40166de2a6451.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_8e6372b5fab285b07c3e27f11c74bb44.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_8e6372b5fab285b07c3e27f11c74bb44.jpg already downloaded
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fc8%252F3fc87548e8085355c8ed31e196172dc8%252Fpa%252FWS34507_d635348b8fbefe5333a69ccf63a505a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:23:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_d635348b8fbefe5333a69ccf63a505a0.jpg already downloaded
2026-03-30 12:23:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a, identifier: WS34507
2026-03-30 12:23:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a with identifier: WS34507
2026-03-30 12:23:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a with identifier: WS34507
2026-03-30 12:23:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f3e17fc-ca12-5e94-b018-7bf1d1a7541a with identifier: WS34507 to the API
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:23:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS34507>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:28:55Z',
'fuel_type': 'petrol',
'id': '3f3e17fc-ca12-5e94-b018-7bf1d1a7541a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS34507',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 127301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96d6a447ba835f069c10cff9e02c4239.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_4947c12ff6f6dc06674f0dd316c4a230.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96c2564aca2d7a76aea586de19cb6fdd.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_497912e10cd443326df82528e993bf3d.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_843c1be87818922936af252270355773.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_005d1e8099275e507914d0b2a51f5e38.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_a976e3854b089a66889f194f1650d0c8.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_9d8f77c7d52f4c9782e40166de2a6451.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_8e6372b5fab285b07c3e27f11c74bb44.jpg',
'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_d635348b8fbefe5333a69ccf63a505a0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3763211,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96d6a447ba835f069c10cff9e02c4239.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3440886,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_4947c12ff6f6dc06674f0dd316c4a230.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3219908,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_96c2564aca2d7a76aea586de19cb6fdd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_497912e10cd443326df82528e993bf3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_843c1be87818922936af252270355773.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3245683,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_005d1e8099275e507914d0b2a51f5e38.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_a976e3854b089a66889f194f1650d0c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3483903,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_9d8f77c7d52f4c9782e40166de2a6451.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_8e6372b5fab285b07c3e27f11c74bb44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3e17fc-ca12-5e94-b018-7bf1d1a7541a/3f3e17fc-ca12-5e94-b018-7bf1d1a7541a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2878967,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3f/c8/3fc87548e8085355c8ed31e196172dc8/pa/WS34507_d635348b8fbefe5333a69ccf63a505a0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Yeti 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2012}
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS34507%27 HTTP/1.1" 200 None
2026-03-30 12:23:51 [auto1.it] INFO: Saving data for WS34507: {'created_time': 1774873431.377757, 'last_price_update_time': 1774873431.377768, 'auction_closing_time': 1774970935.0}
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:23:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WS34507') HTTP/1.1" 204 0
2026-03-30 12:23:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG99232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:23:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD04109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:23:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ86305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU36225> (referer: https://www.auto1.com/v1/car-details-view/AU36225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with identifier: AU36225
2026-03-30 12:24:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with scrape type 1
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_0f345dbe90aee2829c515b189214b198.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_0f345dbe90aee2829c515b189214b198.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_e8013a28e56cb65e8421426d9c16a826.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_e8013a28e56cb65e8421426d9c16a826.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_29d20843b672d79c955f73a84b7a508d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_29d20843b672d79c955f73a84b7a508d.jpg not downloaded yet
2026-03-30 12:24:04 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 12 pages/min), scraped 79 items (at 10 items/min)
2026-03-30 12:24:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_de527431e09e9e7f07c780bbfbfd8496.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_de527431e09e9e7f07c780bbfbfd8496.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_7a617be951f96b5dd0281820e20e5c15.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7a617be951f96b5dd0281820e20e5c15.jpg not downloaded yet
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg not downloaded yet
2026-03-30 12:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU37885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e2390>
2026-03-30 12:24:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg saved to cache
2026-03-30 12:24:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG49733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7a617be951f96b5dd0281820e20e5c15.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f72690>
2026-03-30 12:24:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_7a617be951f96b5dd0281820e20e5c15.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7a617be951f96b5dd0281820e20e5c15.jpg saved to cache
2026-03-30 12:24:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH99714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_de527431e09e9e7f07c780bbfbfd8496.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fdbfd0>
2026-03-30 12:24:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_de527431e09e9e7f07c780bbfbfd8496.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_de527431e09e9e7f07c780bbfbfd8496.jpg saved to cache
2026-03-30 12:24:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS49157> (referer: https://www.auto1.com/v1/car-details-view/BS49157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd64644e-62cb-54d6-8c92-9c09a030acef with identifier: BS49157
2026-03-30 12:24:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd64644e-62cb-54d6-8c92-9c09a030acef with scrape type 1
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd64644e-62cb-54d6-8c92-9c09a030acef
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_2b9cbb495601f616954573197d2efb4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_2b9cbb495601f616954573197d2efb4f.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_78fbcc085c379e1780b30141e2b202e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_78fbcc085c379e1780b30141e2b202e3.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_33ba6c01b3a010c317cfe035feb5a6ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_33ba6c01b3a010c317cfe035feb5a6ee.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_73259ea14379f8f368e54feeedff1455.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_73259ea14379f8f368e54feeedff1455.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_96627ebf24c9f40200d390dbcf76198d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_96627ebf24c9f40200d390dbcf76198d.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_1b6c5ad2c831fe4a2991dc427149f1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_1b6c5ad2c831fe4a2991dc427149f1bc.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_610cb8f52359dd4a5e3013bfb10c20b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_610cb8f52359dd4a5e3013bfb10c20b9.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_51c931b54083fd3c97f1d8c2b72f5975.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_51c931b54083fd3c97f1d8c2b72f5975.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_597ce8575c444400f57690ee5137c03b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_597ce8575c444400f57690ee5137c03b.jpg already downloaded
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F73%252Fb97354c83910b83858ad5f87bae1d7cd%252Fpa%252FBS49157_6304606254e71904ced3ba567449754d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_6304606254e71904ced3ba567449754d.jpg already downloaded
2026-03-30 12:24:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd64644e-62cb-54d6-8c92-9c09a030acef, identifier: BS49157
2026-03-30 12:24:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd64644e-62cb-54d6-8c92-9c09a030acef with identifier: BS49157
2026-03-30 12:24:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd64644e-62cb-54d6-8c92-9c09a030acef with identifier: BS49157
2026-03-30 12:24:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd64644e-62cb-54d6-8c92-9c09a030acef with identifier: BS49157 to the API
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS49157>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:54:53Z',
'fuel_type': 'petrol',
'id': 'fd64644e-62cb-54d6-8c92-9c09a030acef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS49157',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 58478,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_2b9cbb495601f616954573197d2efb4f.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_78fbcc085c379e1780b30141e2b202e3.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_33ba6c01b3a010c317cfe035feb5a6ee.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_73259ea14379f8f368e54feeedff1455.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_96627ebf24c9f40200d390dbcf76198d.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_1b6c5ad2c831fe4a2991dc427149f1bc.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_610cb8f52359dd4a5e3013bfb10c20b9.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_51c931b54083fd3c97f1d8c2b72f5975.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_597ce8575c444400f57690ee5137c03b.jpg',
'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_6304606254e71904ced3ba567449754d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_2b9cbb495601f616954573197d2efb4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_78fbcc085c379e1780b30141e2b202e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_33ba6c01b3a010c317cfe035feb5a6ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_73259ea14379f8f368e54feeedff1455.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_96627ebf24c9f40200d390dbcf76198d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_1b6c5ad2c831fe4a2991dc427149f1bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_610cb8f52359dd4a5e3013bfb10c20b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_51c931b54083fd3c97f1d8c2b72f5975.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_597ce8575c444400f57690ee5137c03b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd64644e-62cb-54d6-8c92-9c09a030acef/fd64644e-62cb-54d6-8c92-9c09a030acef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/73/b97354c83910b83858ad5f87bae1d7cd/pa/BS49157_6304606254e71904ced3ba567449754d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2023}
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS49157%27 HTTP/1.1" 200 None
2026-03-30 12:24:17 [auto1.it] INFO: Saving data for BS49157: {'created_time': 1774873457.320059, 'last_price_update_time': 1774873457.320072, 'auction_closing_time': 1774972493.0}
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BS49157') HTTP/1.1" 204 0
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT27907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a95dd0>
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg saved to cache
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_29d20843b672d79c955f73a84b7a508d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_e8013a28e56cb65e8421426d9c16a826.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd5410>
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_29d20843b672d79c955f73a84b7a508d.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_29d20843b672d79c955f73a84b7a508d.jpg saved to cache
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010942e90>
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_e8013a28e56cb65e8421426d9c16a826.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_e8013a28e56cb65e8421426d9c16a826.jpg saved to cache
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_0f345dbe90aee2829c515b189214b198.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f626d0>
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_0f345dbe90aee2829c515b189214b198.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_0f345dbe90aee2829c515b189214b198.jpg saved to cache
2026-03-30 12:24:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f73010>
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg saved to cache
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA22796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f61310>
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg saved to cache
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f28b90>
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F8d%252Fbf8d0113b18415e28d2bab9b25e7b29a%252Fpa%252FAU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg saved to cache
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f
2026-03-30 12:24:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f, skipping ID generation
2026-03-30 12:24:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with scrape type 1
2026-03-30 12:24:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0957c71e-38c6-5b0c-ad1c-7b8966c9165f sending to next pipeline
2026-03-30 12:24:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f, identifier: AU36225
2026-03-30 12:24:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with identifier: AU36225
2026-03-30 12:24:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with identifier: AU36225
2026-03-30 12:24:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0957c71e-38c6-5b0c-ad1c-7b8966c9165f with identifier: AU36225 to the API
2026-03-30 12:24:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:59:47Z',
'fuel_type': 'hybrid',
'id': '0957c71e-38c6-5b0c-ad1c-7b8966c9165f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU36225',
'listing': 'auction',
'location': 'IT, Garbagnate Milanese',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 125284,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2675138,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_a3fe44c4f4f58cf1f7b07f8c2c9bb519.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_011835665cb6fe9c6e99cf3a71ddce6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2494380,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_625ba3b98fe21e9aa439349d8bd08a06.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_0f345dbe90aee2829c515b189214b198.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2541952,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_e8013a28e56cb65e8421426d9c16a826.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_29d20843b672d79c955f73a84b7a508d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7fd1c80fe3cfdc8ddac1eeb326b58f28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_de527431e09e9e7f07c780bbfbfd8496.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_7a617be951f96b5dd0281820e20e5c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0957c71e-38c6-5b0c-ad1c-7b8966c9165f/0957c71e-38c6-5b0c-ad1c-7b8966c9165f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbf/8d/bf8d0113b18415e28d2bab9b25e7b29a/pa/AU36225_cb793e886f4af5d5d0fc2fd386bec62c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU36225%27 HTTP/1.1" 200 None
2026-03-30 12:24:19 [auto1.it] INFO: Saving data for AU36225: {'created_time': 1774873459.433911, 'last_price_update_time': 1774873459.433924, 'auction_closing_time': 1774972787.0}
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU36225') HTTP/1.1" 204 0
2026-03-30 12:24:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF48403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG99232> (referer: https://www.auto1.com/v1/car-details-view/JG99232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-03-30 12:24:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a8139b-869f-5d28-8e30-7a08b935e2bf with scrape type 1
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_3ebdbdff25d37498b7036f002a625796.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_2ca9dd1713257b2bc235fed8652952e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_b2ad02491a496500a94b7b22e7ca289b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_59d13d4830098c27c65a69b99690adb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_f066eccfc735d341662856ecf2803961.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_296b798f669198ae50daff7cd7c451ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg already downloaded
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Fde%252F2bde239312977fc6d69d3a7713bc71a6%252Fpa%252FJG99232_66198b5e5cb67d8e80da94c7978b0981.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg already downloaded
2026-03-30 12:24:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43a8139b-869f-5d28-8e30-7a08b935e2bf, identifier: JG99232
2026-03-30 12:24:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-03-30 12:24:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-03-30 12:24:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232 to the API
2026-03-30 12:24:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG99232>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:37:10Z',
'fuel_type': 'diesel',
'id': '43a8139b-869f-5d28-8e30-7a08b935e2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG99232',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Audi',
'model': 'Q2',
'odometer': 286311,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg',
'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693926,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-30 12:24:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG99232%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [auto1.it] INFO: Saving data for JG99232: {'created_time': 1774873462.00201, 'last_price_update_time': 1774873462.002021, 'auction_closing_time': 1774971430.0}
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JG99232') HTTP/1.1" 204 0
2026-03-30 12:24:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD04109> (referer: https://www.auto1.com/v1/car-details-view/TD04109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with identifier: TD04109
2026-03-30 12:24:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with scrape type 1
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg not downloaded yet
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_ad73d63c692b6acb99c535bb7997b570.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_ad73d63c692b6acb99c535bb7997b570.jpg not downloaded yet
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg not downloaded yet
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg not downloaded yet
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_85f249b88646a41562d2f3f45dcbd57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_85f249b88646a41562d2f3f45dcbd57c.jpg not downloaded yet
2026-03-30 12:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ86305> (referer: https://www.auto1.com/v1/car-details-view/CZ86305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with identifier: CZ86305
2026-03-30 12:24:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with scrape type 1
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_c22646f65f3b9c8affc64db679b15437.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_c22646f65f3b9c8affc64db679b15437.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_6c95527061567f75a1f9d0f07d48b219.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_6c95527061567f75a1f9d0f07d48b219.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_84ac5730739154e9b8c1c046badbc332.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_84ac5730739154e9b8c1c046badbc332.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_033253583ec9ab31069250c94587a787.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_033253583ec9ab31069250c94587a787.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg not downloaded yet
2026-03-30 12:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_85f249b88646a41562d2f3f45dcbd57c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg not downloaded yet
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg not downloaded yet
2026-03-30 12:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f626d0>
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_85f249b88646a41562d2f3f45dcbd57c.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_85f249b88646a41562d2f3f45dcbd57c.jpg saved to cache
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f491d0>
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg saved to cache
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e3a10>
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg saved to cache
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091e290>
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg saved to cache
2026-03-30 12:24:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_033253583ec9ab31069250c94587a787.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a44990>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1ee10>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_033253583ec9ab31069250c94587a787.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_033253583ec9ab31069250c94587a787.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_84ac5730739154e9b8c1c046badbc332.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e3410>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_84ac5730739154e9b8c1c046badbc332.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_84ac5730739154e9b8c1c046badbc332.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108e15d0>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_6c95527061567f75a1f9d0f07d48b219.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_c22646f65f3b9c8affc64db679b15437.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f60950>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff5610>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_6c95527061567f75a1f9d0f07d48b219.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_6c95527061567f75a1f9d0f07d48b219.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f48c50>
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F98%252Ff898de7674ba6ae238f60bc0c67df1f0%252Fpa%252FCZ86305_c22646f65f3b9c8affc64db679b15437.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_c22646f65f3b9c8affc64db679b15437.jpg saved to cache
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01
2026-03-30 12:24:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 171926b8-0f6c-5161-8f93-0fd53cc5ec01, skipping ID generation
2026-03-30 12:24:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with scrape type 1
2026-03-30 12:24:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 171926b8-0f6c-5161-8f93-0fd53cc5ec01 sending to next pipeline
2026-03-30 12:24:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 171926b8-0f6c-5161-8f93-0fd53cc5ec01, identifier: CZ86305
2026-03-30 12:24:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with identifier: CZ86305
2026-03-30 12:24:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with identifier: CZ86305
2026-03-30 12:24:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 171926b8-0f6c-5161-8f93-0fd53cc5ec01 with identifier: CZ86305 to the API
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_c22646f65f3b9c8affc64db679b15437.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:44:40Z',
'fuel_type': 'diesel',
'id': '171926b8-0f6c-5161-8f93-0fd53cc5ec01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ86305',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': '500X',
'odometer': 75699,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_c22646f65f3b9c8affc64db679b15437.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_6c95527061567f75a1f9d0f07d48b219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_dd103c32032daf62ab9ede8e8566d32f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_ee01cf506e00105fce0eca0cf42f053c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_84ac5730739154e9b8c1c046badbc332.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_033253583ec9ab31069250c94587a787.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_b6a3f4aaf9d99bb0ae3461f1c7ef9ff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e7c2d06ee1d6ddb18e0b378ee4eac71d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_5e04592425e72dcb1e846027afc0c0f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_171926b8-0f6c-5161-8f93-0fd53cc5ec01/171926b8-0f6c-5161-8f93-0fd53cc5ec01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/98/f898de7674ba6ae238f60bc0c67df1f0/pa/CZ86305_e14a8723ed3d7c7c6503e1996c3d9045.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM City Cross',
'transmission': 'automatic',
'trim': 'City Cross',
'year': 2019}
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ86305%27 HTTP/1.1" 200 None
2026-03-30 12:24:25 [auto1.it] INFO: Saving data for CZ86305: {'created_time': 1774873465.584147, 'last_price_update_time': 1774873465.584158, 'auction_closing_time': 1774971880.0}
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ86305') HTTP/1.1" 204 0
2026-03-30 12:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a46d10>
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg saved to cache
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_ad73d63c692b6acb99c535bb7997b570.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601090b5d0>
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg saved to cache
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010935490>
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_ad73d63c692b6acb99c535bb7997b570.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_ad73d63c692b6acb99c535bb7997b570.jpg saved to cache
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa51d0>
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fcf%252F00cf8842c60b71ffa59a8f5b0e8c7118%252Fpa%252FTD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg saved to cache
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc
2026-03-30 12:24:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc, skipping ID generation
2026-03-30 12:24:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with scrape type 1
2026-03-30 12:24:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc sending to next pipeline
2026-03-30 12:24:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc, identifier: TD04109
2026-03-30 12:24:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with identifier: TD04109
2026-03-30 12:24:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with identifier: TD04109
2026-03-30 12:24:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc with identifier: TD04109 to the API
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.3L',
'engine_horse_power': 98,
'expiration_date': '2026-03-31T15:49:15Z',
'fuel_type': 'diesel',
'id': 'd2468c05-5c9d-5ab6-a4f4-e45903ebb8dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD04109',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 169134,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_375afcd9314fec6de2ceb6f8dc0d107b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_ad73d63c692b6acb99c535bb7997b570.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_fc3cae32d94f6bd3b8adb8d3835fedfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_0d670b5b41aa47fdc2b7f1cab9cd1747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc/d2468c05-5c9d-5ab6-a4f4-e45903ebb8dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/cf/00cf8842c60b71ffa59a8f5b0e8c7118/pa/TD04109_85f249b88646a41562d2f3f45dcbd57c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1997-08-05',
'seats_number': 7,
'seller_name': None,
'title': 'Mercedes-Benz Vito 110 D',
'transmission': 'manual',
'trim': '',
'year': 1997}
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04109%27 HTTP/1.1" 200 None
2026-03-30 12:24:26 [auto1.it] INFO: Saving data for TD04109: {'created_time': 1774873466.382796, 'last_price_update_time': 1774873466.382808, 'auction_closing_time': 1774972155.0}
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD04109') HTTP/1.1" 204 0
2026-03-30 12:24:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW91242> (referer: https://www.auto1.com/v1/car-details-view/LW91242/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7b6f6d-bede-5df9-95bb-edec34f933b8 with identifier: LW91242
2026-03-30 12:24:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7b6f6d-bede-5df9-95bb-edec34f933b8 with scrape type 1
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d7b6f6d-bede-5df9-95bb-edec34f933b8
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_4c6f4c2c0b40ee1e7da917f4edd4b63c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_4c6f4c2c0b40ee1e7da917f4edd4b63c.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_e88d907b69c5d06f408104b2baf2b459.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_e88d907b69c5d06f408104b2baf2b459.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_cfc36350d2d96f10c316c7dbedb1d434.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_cfc36350d2d96f10c316c7dbedb1d434.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_d19f3eaefea39ea4e1a96e44e1514d24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d19f3eaefea39ea4e1a96e44e1514d24.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_c998c54083db78aadbdc45834630bad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_c998c54083db78aadbdc45834630bad4.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_7f591645b1fa2615fb60b7eb06186b4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_7f591645b1fa2615fb60b7eb06186b4e.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_68669bfc7707299d9ed62bc0254fd431.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_68669bfc7707299d9ed62bc0254fd431.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_3b1b9c0b52b9303d04aa191e5fbcb8c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_3b1b9c0b52b9303d04aa191e5fbcb8c3.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_d7fd3d5a7dc4ab542b4a91953a270cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d7fd3d5a7dc4ab542b4a91953a270cad.jpg already downloaded
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F61%252Fa66144f52250a1d036e1386ba25738d2%252Fpa%252FLW91242_5f7dfd9f0032a2ff25241b4ae4cb5889.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_5f7dfd9f0032a2ff25241b4ae4cb5889.jpg already downloaded
2026-03-30 12:24:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7d7b6f6d-bede-5df9-95bb-edec34f933b8, identifier: LW91242
2026-03-30 12:24:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7d7b6f6d-bede-5df9-95bb-edec34f933b8 with identifier: LW91242
2026-03-30 12:24:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7d7b6f6d-bede-5df9-95bb-edec34f933b8 with identifier: LW91242
2026-03-30 12:24:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7d7b6f6d-bede-5df9-95bb-edec34f933b8 with identifier: LW91242 to the API
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW91242>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:18:02Z',
'fuel_type': 'diesel',
'id': '7d7b6f6d-bede-5df9-95bb-edec34f933b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW91242',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Peugeot',
'model': '208',
'odometer': 174943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_4c6f4c2c0b40ee1e7da917f4edd4b63c.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_e88d907b69c5d06f408104b2baf2b459.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_cfc36350d2d96f10c316c7dbedb1d434.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d19f3eaefea39ea4e1a96e44e1514d24.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_c998c54083db78aadbdc45834630bad4.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_7f591645b1fa2615fb60b7eb06186b4e.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_68669bfc7707299d9ed62bc0254fd431.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_3b1b9c0b52b9303d04aa191e5fbcb8c3.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d7fd3d5a7dc4ab542b4a91953a270cad.jpg',
'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_5f7dfd9f0032a2ff25241b4ae4cb5889.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_4c6f4c2c0b40ee1e7da917f4edd4b63c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2761320,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_e88d907b69c5d06f408104b2baf2b459.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_cfc36350d2d96f10c316c7dbedb1d434.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818902,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d19f3eaefea39ea4e1a96e44e1514d24.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_c998c54083db78aadbdc45834630bad4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_7f591645b1fa2615fb60b7eb06186b4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571088,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_68669bfc7707299d9ed62bc0254fd431.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_3b1b9c0b52b9303d04aa191e5fbcb8c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_d7fd3d5a7dc4ab542b4a91953a270cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d7b6f6d-bede-5df9-95bb-edec34f933b8/7d7b6f6d-bede-5df9-95bb-edec34f933b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/61/a66144f52250a1d036e1386ba25738d2/pa/LW91242_5f7dfd9f0032a2ff25241b4ae4cb5889.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW91242%27 HTTP/1.1" 200 None
2026-03-30 12:24:33 [auto1.it] INFO: Saving data for LW91242: {'created_time': 1774873473.721381, 'last_price_update_time': 1774873473.721413, 'auction_closing_time': 1774970282.0}
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW91242') HTTP/1.1" 204 0
2026-03-30 12:24:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU37885> (referer: https://www.auto1.com/v1/car-details-view/EU37885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-03-30 12:24:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe76f577-dc91-55cf-b589-9c329a84067b with scrape type 1
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg not downloaded yet
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg not downloaded yet
2026-03-30 12:24:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH99714> (referer: https://www.auto1.com/v1/car-details-view/CH99714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7aefba6-a7ee-58ae-aeb4-c067857fae8d with identifier: CH99714
2026-03-30 12:24:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7aefba6-a7ee-58ae-aeb4-c067857fae8d with scrape type 1
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7aefba6-a7ee-58ae-aeb4-c067857fae8d
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_635b6ec7eef2ed06cdba56821c0292de.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_635b6ec7eef2ed06cdba56821c0292de.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_b536da719aeebf83fe7be916d85f4561.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_b536da719aeebf83fe7be916d85f4561.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_f2b1eb8547f29d90603127c0f19d3986.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_f2b1eb8547f29d90603127c0f19d3986.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_2f3c72dc39112a310fd33fb94d0c2911.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2f3c72dc39112a310fd33fb94d0c2911.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_bf80988520edefa4b4bcd4d93eb02c58.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_bf80988520edefa4b4bcd4d93eb02c58.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_2611ebd7c28149baed7e1924268092bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2611ebd7c28149baed7e1924268092bb.jpg already downloaded
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_6e75bedd0440f46c9a62c5ede07141e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_6e75bedd0440f46c9a62c5ede07141e3.jpg already downloaded
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_00a7027554f14b045cabf60043df582f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_00a7027554f14b045cabf60043df582f.jpg already downloaded
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_66c6451d9f71baed1624a46d6589ba8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_66c6451d9f71baed1624a46d6589ba8d.jpg already downloaded
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fa8%252F9da814db04fd6d8f14bc8bcb436dadd5%252Fpa%252FCH99714_e5c382c6c3192a9766c390ec351c0447.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_e5c382c6c3192a9766c390ec351c0447.jpg already downloaded
2026-03-30 12:24:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7aefba6-a7ee-58ae-aeb4-c067857fae8d, identifier: CH99714
2026-03-30 12:24:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7aefba6-a7ee-58ae-aeb4-c067857fae8d with identifier: CH99714
2026-03-30 12:24:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7aefba6-a7ee-58ae-aeb4-c067857fae8d with identifier: CH99714
2026-03-30 12:24:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7aefba6-a7ee-58ae-aeb4-c067857fae8d with identifier: CH99714 to the API
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CH99714>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 325,
'expiration_date': '2026-03-31T15:03:33Z',
'fuel_type': 'diesel',
'id': 'b7aefba6-a7ee-58ae-aeb4-c067857fae8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH99714',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Audi',
'model': 'A6',
'odometer': 143324,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_635b6ec7eef2ed06cdba56821c0292de.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_b536da719aeebf83fe7be916d85f4561.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_f2b1eb8547f29d90603127c0f19d3986.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2f3c72dc39112a310fd33fb94d0c2911.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_bf80988520edefa4b4bcd4d93eb02c58.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2611ebd7c28149baed7e1924268092bb.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_6e75bedd0440f46c9a62c5ede07141e3.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_00a7027554f14b045cabf60043df582f.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_66c6451d9f71baed1624a46d6589ba8d.jpg',
'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_e5c382c6c3192a9766c390ec351c0447.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2245672,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_635b6ec7eef2ed06cdba56821c0292de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2235577,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_b536da719aeebf83fe7be916d85f4561.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2185287,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_f2b1eb8547f29d90603127c0f19d3986.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2190000,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2f3c72dc39112a310fd33fb94d0c2911.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_bf80988520edefa4b4bcd4d93eb02c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2092919,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_2611ebd7c28149baed7e1924268092bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_6e75bedd0440f46c9a62c5ede07141e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_00a7027554f14b045cabf60043df582f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_66c6451d9f71baed1624a46d6589ba8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7aefba6-a7ee-58ae-aeb4-c067857fae8d/b7aefba6-a7ee-58ae-aeb4-c067857fae8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2215975,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/a8/9da814db04fd6d8f14bc8bcb436dadd5/pa/CH99714_e5c382c6c3192a9766c390ec351c0447.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2018}
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH99714%27 HTTP/1.1" 200 None
2026-03-30 12:24:35 [auto1.it] INFO: Saving data for CH99714: {'created_time': 1774873475.4892, 'last_price_update_time': 1774873475.489214, 'auction_closing_time': 1774969413.0}
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CH99714') HTTP/1.1" 204 0
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109015d0>
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg saved to cache
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109400d0>
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg saved to cache
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd9e50>
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg saved to cache
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8d550>
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg saved to cache
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f56010>
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:24:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fc6%252Fc4c64e46ed0265c9717616f6f277181e%252Fpa%252FEU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg') HTTP/1.1" 204 0
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg saved to cache
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-03-30 12:24:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe76f577-dc91-55cf-b589-9c329a84067b, skipping ID generation
2026-03-30 12:24:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe76f577-dc91-55cf-b589-9c329a84067b with scrape type 1
2026-03-30 12:24:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe76f577-dc91-55cf-b589-9c329a84067b sending to next pipeline
2026-03-30 12:24:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe76f577-dc91-55cf-b589-9c329a84067b, identifier: EU37885
2026-03-30 12:24:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-03-30 12:24:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-03-30 12:24:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885 to the API
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:01:09Z',
'fuel_type': 'diesel',
'id': 'fe76f577-dc91-55cf-b589-9c329a84067b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU37885',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'BMW',
'model': '3er',
'odometer': 200869,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU37885%27 HTTP/1.1" 200 None
2026-03-30 12:24:36 [auto1.it] INFO: Saving data for EU37885: {'created_time': 1774873476.672783, 'last_price_update_time': 1774873476.672794, 'auction_closing_time': 1774969269.0}
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU37885') HTTP/1.1" 204 0
2026-03-30 12:24:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN08161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.926(s), this was the 1st time calling it.
2026-03-30 12:24:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.099219824824317 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:24:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:24:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW36955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG49733> (referer: https://www.auto1.com/v1/car-details-view/VG49733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:24:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:24:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e40e52-5329-559e-b685-6c7f6fb54023 with identifier: VG49733
2026-03-30 12:24:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e40e52-5329-559e-b685-6c7f6fb54023 with scrape type 1
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41e40e52-5329-559e-b685-6c7f6fb54023
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_93bf71813391970696a6554f148a4bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_93bf71813391970696a6554f148a4bf9.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_c5aa84c8422e70f8e02258c911735d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_c5aa84c8422e70f8e02258c911735d4e.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_d45914eb33c86bebf94dc3eba65b0989.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_d45914eb33c86bebf94dc3eba65b0989.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_24240fcb99a06beffa70cbe68c63b617.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_24240fcb99a06beffa70cbe68c63b617.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_6b5c69ce005113be3b1aa35c36c35827.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_6b5c69ce005113be3b1aa35c36c35827.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_294f0559d0d91c4b649c94aaed906422.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_294f0559d0d91c4b649c94aaed906422.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_f4f71b921ff899ef0e039874e9d60174.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_f4f71b921ff899ef0e039874e9d60174.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_79fc3e6458ad96fb7133364950e5b4e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_79fc3e6458ad96fb7133364950e5b4e4.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_5f305d9819475978afdde2fdf360594d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_5f305d9819475978afdde2fdf360594d.jpg already downloaded
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F20%252F0d200d3768f514d98cf2f1b9f669195d%252Fpa%252FVG49733_b10d072150ef580c94ca0cf1d6f86388.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:24:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_b10d072150ef580c94ca0cf1d6f86388.jpg already downloaded
2026-03-30 12:24:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 41e40e52-5329-559e-b685-6c7f6fb54023, identifier: VG49733
2026-03-30 12:24:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 41e40e52-5329-559e-b685-6c7f6fb54023 with identifier: VG49733
2026-03-30 12:24:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 41e40e52-5329-559e-b685-6c7f6fb54023 with identifier: VG49733
2026-03-30 12:24:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 41e40e52-5329-559e-b685-6c7f6fb54023 with identifier: VG49733 to the API
2026-03-30 12:24:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:24:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:24:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG49733>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:55:31Z',
'fuel_type': 'diesel',
'id': '41e40e52-5329-559e-b685-6c7f6fb54023',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG49733',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 186737,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_93bf71813391970696a6554f148a4bf9.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_c5aa84c8422e70f8e02258c911735d4e.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_d45914eb33c86bebf94dc3eba65b0989.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_24240fcb99a06beffa70cbe68c63b617.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_6b5c69ce005113be3b1aa35c36c35827.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_294f0559d0d91c4b649c94aaed906422.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_f4f71b921ff899ef0e039874e9d60174.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_79fc3e6458ad96fb7133364950e5b4e4.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_5f305d9819475978afdde2fdf360594d.jpg',
'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_b10d072150ef580c94ca0cf1d6f86388.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_93bf71813391970696a6554f148a4bf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_c5aa84c8422e70f8e02258c911735d4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_d45914eb33c86bebf94dc3eba65b0989.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_24240fcb99a06beffa70cbe68c63b617.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_6b5c69ce005113be3b1aa35c36c35827.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_294f0559d0d91c4b649c94aaed906422.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_f4f71b921ff899ef0e039874e9d60174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_79fc3e6458ad96fb7133364950e5b4e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_5f305d9819475978afdde2fdf360594d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41e40e52-5329-559e-b685-6c7f6fb54023/41e40e52-5329-559e-b685-6c7f6fb54023_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/20/0d200d3768f514d98cf2f1b9f669195d/pa/VG49733_b10d072150ef580c94ca0cf1d6f86388.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-30 12:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG49733%27 HTTP/1.1" 200 None
2026-03-30 12:24:56 [auto1.it] INFO: Saving data for VG49733: {'created_time': 1774873496.244564, 'last_price_update_time': 1774873496.244576, 'auction_closing_time': 1774972531.0}
2026-03-30 12:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:24:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VG49733') HTTP/1.1" 204 0
2026-03-30 12:25:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF48403> (referer: https://www.auto1.com/v1/car-details-view/BF48403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-03-30 12:25:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5eee9e-aeff-5065-b05b-6092eb81aa21 with scrape type 1
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_aa89d52a74e3821e63881e8477c03b26.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_07fc159a39546097e211bbed0e19adb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_74f23e28fd483e414b72b39c1240e9b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_4a091b5c61eb895c71c15f9748c44d82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_9710d8ccb76aa516d258641e844ebd48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_22b3b5db4fe3861a03207101a262f4c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg already downloaded
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252Fce%252F93ce8bc5a1f3285a98ed704d338abebe%252Fpa%252FBF48403_79ace9b4cff4383687807a70b93d91a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg already downloaded
2026-03-30 12:25:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad5eee9e-aeff-5065-b05b-6092eb81aa21, identifier: BF48403
2026-03-30 12:25:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-03-30 12:25:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-03-30 12:25:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403 to the API
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BF48403>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:30:43Z',
'fuel_type': 'diesel',
'id': 'ad5eee9e-aeff-5065-b05b-6092eb81aa21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF48403',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'Audi',
'model': 'A4',
'odometer': 164288,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg',
'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 40 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF48403%27 HTTP/1.1" 200 None
2026-03-30 12:25:04 [auto1.it] INFO: Saving data for BF48403: {'created_time': 1774873504.659049, 'last_price_update_time': 1774873504.659064, 'auction_closing_time': 1774971043.0}
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BF48403') HTTP/1.1" 204 0
2026-03-30 12:25:04 [scrapy.extensions.logstats] INFO: Crawled 144 pages (at 17 pages/min), scraped 89 items (at 10 items/min)
2026-03-30 12:25:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:25:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR33075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA22796> (referer: https://www.auto1.com/v1/car-details-view/JA22796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with identifier: JA22796
2026-03-30 12:25:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with scrape type 1
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_cc4c92244f9c67e800269990dbd414cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_cc4c92244f9c67e800269990dbd414cc.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_edd3140909a26eab7c24c72d6015eeb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_edd3140909a26eab7c24c72d6015eeb5.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_23812e33ff8c6d90341c23c539121bb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_23812e33ff8c6d90341c23c539121bb6.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_bc921768c4b386ead25008de1e495589.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bc921768c4b386ead25008de1e495589.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_bf68a2ba1d381d039280cacc7afbe317.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bf68a2ba1d381d039280cacc7afbe317.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_2ea611221126d307e08524ed1e56abf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_2ea611221126d307e08524ed1e56abf3.jpg not downloaded yet
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_01cda3d772801d7b349101372223dfbe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_01cda3d772801d7b349101372223dfbe.jpg not downloaded yet
2026-03-30 12:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB41504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_01cda3d772801d7b349101372223dfbe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV57327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e24dd0>
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_01cda3d772801d7b349101372223dfbe.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_01cda3d772801d7b349101372223dfbe.jpg saved to cache
2026-03-30 12:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_2ea611221126d307e08524ed1e56abf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd9710>
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_2ea611221126d307e08524ed1e56abf3.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_2ea611221126d307e08524ed1e56abf3.jpg saved to cache
2026-03-30 12:25:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bf68a2ba1d381d039280cacc7afbe317.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1ca90>
2026-03-30 12:25:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_bf68a2ba1d381d039280cacc7afbe317.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bf68a2ba1d381d039280cacc7afbe317.jpg saved to cache
2026-03-30 12:25:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP37147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bc921768c4b386ead25008de1e495589.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a44d10>
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_bc921768c4b386ead25008de1e495589.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bc921768c4b386ead25008de1e495589.jpg saved to cache
2026-03-30 12:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1d890>
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg saved to cache
2026-03-30 12:25:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL89401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_23812e33ff8c6d90341c23c539121bb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f66610>
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_23812e33ff8c6d90341c23c539121bb6.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_23812e33ff8c6d90341c23c539121bb6.jpg saved to cache
2026-03-30 12:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a40310>
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg saved to cache
2026-03-30 12:25:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN08161> (referer: https://www.auto1.com/v1/car-details-view/NN08161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ccb9fc-0151-5359-83fc-1838a745189a with identifier: NN08161
2026-03-30 12:25:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ccb9fc-0151-5359-83fc-1838a745189a with scrape type 1
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg not downloaded yet
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b05ed0>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_a40e8c5bfd70a8dbece1685be583707e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_a40e8c5bfd70a8dbece1685be583707e.jpg not downloaded yet
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_edd3140909a26eab7c24c72d6015eeb5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_112e17b6490120d3665a223b91e6fd11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_112e17b6490120d3665a223b91e6fd11.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_5660019e337d955f6aaec00520721538.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_5660019e337d955f6aaec00520721538.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg not downloaded yet
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_0f1147959ec589700ffa61e6b1403a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_0f1147959ec589700ffa61e6b1403a63.jpg not downloaded yet
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010941e90>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_edd3140909a26eab7c24c72d6015eeb5.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_edd3140909a26eab7c24c72d6015eeb5.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2c610>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_0f1147959ec589700ffa61e6b1403a63.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010908690>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_0f1147959ec589700ffa61e6b1403a63.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_0f1147959ec589700ffa61e6b1403a63.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2de50>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ81655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_5660019e337d955f6aaec00520721538.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa7c90>
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg saved to cache
2026-03-30 12:25:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_a40e8c5bfd70a8dbece1685be583707e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_112e17b6490120d3665a223b91e6fd11.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff7550>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_5660019e337d955f6aaec00520721538.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_5660019e337d955f6aaec00520721538.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f685d0>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_a40e8c5bfd70a8dbece1685be583707e.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_a40e8c5bfd70a8dbece1685be583707e.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3bc90>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_112e17b6490120d3665a223b91e6fd11.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_112e17b6490120d3665a223b91e6fd11.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f43f90>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091f490>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_cc4c92244f9c67e800269990dbd414cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f42950>
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F61%252F6b610acf6ab962ed1d7225517bbebb14%252Fpa%252FNN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg saved to cache
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73ccb9fc-0151-5359-83fc-1838a745189a
2026-03-30 12:25:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73ccb9fc-0151-5359-83fc-1838a745189a, skipping ID generation
2026-03-30 12:25:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ccb9fc-0151-5359-83fc-1838a745189a with scrape type 1
2026-03-30 12:25:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73ccb9fc-0151-5359-83fc-1838a745189a sending to next pipeline
2026-03-30 12:25:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 73ccb9fc-0151-5359-83fc-1838a745189a, identifier: NN08161
2026-03-30 12:25:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 73ccb9fc-0151-5359-83fc-1838a745189a with identifier: NN08161
2026-03-30 12:25:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 73ccb9fc-0151-5359-83fc-1838a745189a with identifier: NN08161
2026-03-30 12:25:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 73ccb9fc-0151-5359-83fc-1838a745189a with identifier: NN08161 to the API
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 48,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:38:33Z',
'fuel_type': 'hybrid',
'id': '73ccb9fc-0151-5359-83fc-1838a745189a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN08161',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Jeep',
'model': 'Compass',
'odometer': 84493,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2329109,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_90368a91fd625d9cc7b8466e24d91d3d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3d54b4f97d32bafae0606d1e2f2fdd27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2217850,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_9658b7d4393126d30af9fa5aec2dfdbb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2208862,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_3aecf8a853b5359c7996f5ac2e3feb02.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170240,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_a40e8c5bfd70a8dbece1685be583707e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_112e17b6490120d3665a223b91e6fd11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2234611,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_5660019e337d955f6aaec00520721538.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_2a08e0e5c7e8c90dcaac8ed999b961f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343508,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_f0f9d737316a857f3e573f3c7d9a9616.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73ccb9fc-0151-5359-83fc-1838a745189a/73ccb9fc-0151-5359-83fc-1838a745189a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/61/6b610acf6ab962ed1d7225517bbebb14/pa/NN08161_0f1147959ec589700ffa61e6b1403a63.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2021}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NN08161%27 HTTP/1.1" 200 None
2026-03-30 12:25:32 [auto1.it] INFO: Saving data for NN08161: {'created_time': 1774873532.018208, 'last_price_update_time': 1774873532.018219, 'auction_closing_time': 1774971513.0}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NN08161') HTTP/1.1" 204 0
2026-03-30 12:25:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.105(s), this was the 2nd time calling it.
2026-03-30 12:25:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.469100977771216 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f98c10>
2026-03-30 12:25:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F21%252Ff3211343e723f8a9e2d58be88c95fd8f%252Fpa%252FJA22796_cc4c92244f9c67e800269990dbd414cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_cc4c92244f9c67e800269990dbd414cc.jpg saved to cache
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8
2026-03-30 12:25:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8, skipping ID generation
2026-03-30 12:25:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with scrape type 1
2026-03-30 12:25:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 sending to next pipeline
2026-03-30 12:25:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8, identifier: JA22796
2026-03-30 12:25:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with identifier: JA22796
2026-03-30 12:25:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with identifier: JA22796
2026-03-30 12:25:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 799b1bd1-a477-5278-b9c4-de7c2c9ffac8 with identifier: JA22796 to the API
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_cc4c92244f9c67e800269990dbd414cc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:29:08Z',
'fuel_type': 'diesel',
'id': '799b1bd1-a477-5278-b9c4-de7c2c9ffac8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA22796',
'listing': 'auction',
'location': 'IT, Rende',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 98542,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_cc4c92244f9c67e800269990dbd414cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_edd3140909a26eab7c24c72d6015eeb5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_f850fbb1b310d0235adfa309cfa1eadb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_437a5a491b0c3c93fde2f7a3583c1ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_23812e33ff8c6d90341c23c539121bb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_ef9d94ef7226042320d6ed88fa41a0ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bc921768c4b386ead25008de1e495589.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_bf68a2ba1d381d039280cacc7afbe317.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_2ea611221126d307e08524ed1e56abf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799b1bd1-a477-5278-b9c4-de7c2c9ffac8/799b1bd1-a477-5278-b9c4-de7c2c9ffac8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/21/f3211343e723f8a9e2d58be88c95fd8f/pa/JA22796_01cda3d772801d7b349101372223dfbe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque D150 Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA22796%27 HTTP/1.1" 200 None
2026-03-30 12:25:32 [auto1.it] INFO: Saving data for JA22796: {'created_time': 1774873532.551871, 'last_price_update_time': 1774873532.551885, 'auction_closing_time': 1774970948.0}
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JA22796') HTTP/1.1" 204 0
2026-03-30 12:25:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF50602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:34 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3585 | hits on page: 40
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: EU37885
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU37885%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for EU37885: 0
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: TD04109
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04109%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for TD04109: 0
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: JU97705
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: TL25459
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: FP07384
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP07384%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for FP07384: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: LS76458
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS76458%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for LS76458: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: YB58118
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: XN06178
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN06178%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for XN06178: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: VG88354
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: VL80558
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: JX31919
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: YK44685
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK44685%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for YK44685: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: WL53757
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: WH99295
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH99295%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for WH99295: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: EK95526
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK95526%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for EK95526: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: MX84486
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX84486%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for MX84486: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: NY50205
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: LE25949
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE25949%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for LE25949: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: VY93088
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY93088%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for VY93088: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: HC44439
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: NW55395
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: DY94164
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: ZB19627
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB19627%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for ZB19627: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: FG50671
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: EA93789
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: DW52067
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW52067%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for DW52067: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: HD92307
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: XY76209
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY76209%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for XY76209: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: ER46534
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: FL86177
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: ZV35786
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV35786%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for ZV35786: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: HU07097
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU07097%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for HU07097: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: EB58973
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB58973%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for EB58973: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: HC29522
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: EL35572
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL35572%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for EL35572: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: KL43358
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL43358%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for KL43358: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: AR77304
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR77304%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for AR77304: 1
2026-03-30 12:25:34 [auto1.it] INFO: Found listing with ID: UP99994
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP99994%27 HTTP/1.1" 200 None
2026-03-30 12:25:34 [auto1.it] INFO: Scrape type for UP99994: 2
2026-03-30 12:25:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f14f32f-6577-5931-8ce4-1b67cf805a8c with identifier: UP99994
2026-03-30 12:25:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f14f32f-6577-5931-8ce4-1b67cf805a8c with scrape type 2
2026-03-30 12:25:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f14f32f-6577-5931-8ce4-1b67cf805a8c with scrape type 2
2026-03-30 12:25:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6f14f32f-6577-5931-8ce4-1b67cf805a8c, identifier: UP99994
2026-03-30 12:25:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6f14f32f-6577-5931-8ce4-1b67cf805a8c with identifier: UP99994
2026-03-30 12:25:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6f14f32f-6577-5931-8ce4-1b67cf805a8c with identifier: UP99994
2026-03-30 12:25:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6f14f32f-6577-5931-8ce4-1b67cf805a8c with identifier: UP99994 to the API
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:47:37Z',
'fuel_type': 'petrol',
'id': '6f14f32f-6577-5931-8ce4-1b67cf805a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP99994',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 43457,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2022}
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP99994%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [auto1.it] INFO: Saving data for UP99994: {'auction_closing_time': 1774972057.0, 'created_time': 1772785170.509575, 'last_price_update_time': 1774873535.361252}
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP99994') HTTP/1.1" 204 0
2026-03-30 12:25:35 [auto1.it] INFO: Found listing with ID: XT78781
2026-03-30 12:25:35 [auto1.it] INFO: Found listing with ID: XV44549
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV44549%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [auto1.it] INFO: Scrape type for XV44549: 1
2026-03-30 12:25:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR33075> (referer: https://www.auto1.com/v1/car-details-view/TR33075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0e2080-7ff4-5b16-927f-536e211d73b6 with identifier: TR33075
2026-03-30 12:25:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0e2080-7ff4-5b16-927f-536e211d73b6 with scrape type 1
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a0e2080-7ff4-5b16-927f-536e211d73b6
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_a50550424852844f8547f4ef402e6b06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_a50550424852844f8547f4ef402e6b06.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_3fbf4e5c474105811b98a9ca8525f3e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_3fbf4e5c474105811b98a9ca8525f3e9.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_b3b4120bc32c45bc2e9bc198ce16013b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b3b4120bc32c45bc2e9bc198ce16013b.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_1fd9a7e16fac40a0d0e64d8cf6a9b47d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_1fd9a7e16fac40a0d0e64d8cf6a9b47d.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_b7f02862cae4c3277f0666f096213764.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b7f02862cae4c3277f0666f096213764.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_91534cfbbb9bdd151e307402b8442292.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_91534cfbbb9bdd151e307402b8442292.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_15e16c5b39b5ed86a32e99d85c4dfbd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_15e16c5b39b5ed86a32e99d85c4dfbd6.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_37ea49445e7dfc7a5f276ef756584c3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_37ea49445e7dfc7a5f276ef756584c3f.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_b126299d8c1199fb53e26b77fb477f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b126299d8c1199fb53e26b77fb477f23.jpg already downloaded
2026-03-30 12:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F15%252Fd415fff3d40afae9561bac9cfe18e608%252Fpa%252FTR33075_5e53ea0c86dd46ecd579c1a42f730e85.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_5e53ea0c86dd46ecd579c1a42f730e85.jpg already downloaded
2026-03-30 12:25:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a0e2080-7ff4-5b16-927f-536e211d73b6, identifier: TR33075
2026-03-30 12:25:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a0e2080-7ff4-5b16-927f-536e211d73b6 with identifier: TR33075
2026-03-30 12:25:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a0e2080-7ff4-5b16-927f-536e211d73b6 with identifier: TR33075
2026-03-30 12:25:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a0e2080-7ff4-5b16-927f-536e211d73b6 with identifier: TR33075 to the API
2026-03-30 12:25:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR33075>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:25:24Z',
'fuel_type': 'petrol',
'id': '9a0e2080-7ff4-5b16-927f-536e211d73b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR33075',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 80907,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_a50550424852844f8547f4ef402e6b06.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_3fbf4e5c474105811b98a9ca8525f3e9.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b3b4120bc32c45bc2e9bc198ce16013b.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_1fd9a7e16fac40a0d0e64d8cf6a9b47d.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b7f02862cae4c3277f0666f096213764.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_91534cfbbb9bdd151e307402b8442292.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_15e16c5b39b5ed86a32e99d85c4dfbd6.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_37ea49445e7dfc7a5f276ef756584c3f.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b126299d8c1199fb53e26b77fb477f23.jpg',
'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_5e53ea0c86dd46ecd579c1a42f730e85.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_a50550424852844f8547f4ef402e6b06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_3fbf4e5c474105811b98a9ca8525f3e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b3b4120bc32c45bc2e9bc198ce16013b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_1fd9a7e16fac40a0d0e64d8cf6a9b47d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b7f02862cae4c3277f0666f096213764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_91534cfbbb9bdd151e307402b8442292.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_15e16c5b39b5ed86a32e99d85c4dfbd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_37ea49445e7dfc7a5f276ef756584c3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_b126299d8c1199fb53e26b77fb477f23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e2080-7ff4-5b16-927f-536e211d73b6/9a0e2080-7ff4-5b16-927f-536e211d73b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/15/d415fff3d40afae9561bac9cfe18e608/pa/TR33075_5e53ea0c86dd46ecd579c1a42f730e85.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2011}
2026-03-30 12:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR33075%27 HTTP/1.1" 200 None
2026-03-30 12:25:37 [auto1.it] INFO: Saving data for TR33075: {'created_time': 1774873537.08557, 'last_price_update_time': 1774873537.085582, 'auction_closing_time': 1774970724.0}
2026-03-30 12:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR33075') HTTP/1.1" 204 0
2026-03-30 12:25:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.042(s), this was the 2nd time calling it.
2026-03-30 12:25:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.265600213629971 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.862(s), this was the 1st time calling it.
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.456791016717224 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:25:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB41504> (referer: https://www.auto1.com/v1/car-details-view/HB41504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3402c073-78b3-5c12-8745-31abe12be284 with identifier: HB41504
2026-03-30 12:25:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3402c073-78b3-5c12-8745-31abe12be284 with scrape type 1
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3402c073-78b3-5c12-8745-31abe12be284
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_c1ac58abd4b35bdfbbd37aa7cb649723.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_c1ac58abd4b35bdfbbd37aa7cb649723.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_0ba2c27a6f811c4f125711e6420f8927.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_0ba2c27a6f811c4f125711e6420f8927.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_36ada4427b2d88eeffddd11395916077.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_36ada4427b2d88eeffddd11395916077.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_797d4c28634d70ebc67dc3518b549be7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_797d4c28634d70ebc67dc3518b549be7.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_b32fd155239c777dcbac0f62927ecec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_b32fd155239c777dcbac0f62927ecec1.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_bc262192e7e2676e31332cc582925fdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_bc262192e7e2676e31332cc582925fdb.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_2e4fbf947dff5f1e91230bf9dccec092.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_2e4fbf947dff5f1e91230bf9dccec092.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_3d919bcf4bf3437cfe85ed775c9b8f79.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_3d919bcf4bf3437cfe85ed775c9b8f79.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_fce6ec067873e84ba485a8b8f006170c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_fce6ec067873e84ba485a8b8f006170c.jpg already downloaded
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F24%252F1e247d69885f99088e68c65b18d75006%252Fpa%252FHB41504_298b183c956687fb2610385b38ebb9ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_298b183c956687fb2610385b38ebb9ae.jpg already downloaded
2026-03-30 12:25:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3402c073-78b3-5c12-8745-31abe12be284, identifier: HB41504
2026-03-30 12:25:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3402c073-78b3-5c12-8745-31abe12be284 with identifier: HB41504
2026-03-30 12:25:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3402c073-78b3-5c12-8745-31abe12be284 with identifier: HB41504
2026-03-30 12:25:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3402c073-78b3-5c12-8745-31abe12be284 with identifier: HB41504 to the API
2026-03-30 12:25:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB41504>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-03-31T15:20:40Z',
'fuel_type': 'petrol',
'id': '3402c073-78b3-5c12-8745-31abe12be284',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB41504',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'MINI',
'model': 'Countryman',
'odometer': 63511,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_c1ac58abd4b35bdfbbd37aa7cb649723.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_0ba2c27a6f811c4f125711e6420f8927.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_36ada4427b2d88eeffddd11395916077.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_797d4c28634d70ebc67dc3518b549be7.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_b32fd155239c777dcbac0f62927ecec1.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_bc262192e7e2676e31332cc582925fdb.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_2e4fbf947dff5f1e91230bf9dccec092.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_3d919bcf4bf3437cfe85ed775c9b8f79.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_fce6ec067873e84ba485a8b8f006170c.jpg',
'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_298b183c956687fb2610385b38ebb9ae.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_c1ac58abd4b35bdfbbd37aa7cb649723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_0ba2c27a6f811c4f125711e6420f8927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_36ada4427b2d88eeffddd11395916077.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_797d4c28634d70ebc67dc3518b549be7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_b32fd155239c777dcbac0f62927ecec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_bc262192e7e2676e31332cc582925fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_2e4fbf947dff5f1e91230bf9dccec092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_3d919bcf4bf3437cfe85ed775c9b8f79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_fce6ec067873e84ba485a8b8f006170c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3402c073-78b3-5c12-8745-31abe12be284/3402c073-78b3-5c12-8745-31abe12be284_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/24/1e247d69885f99088e68c65b18d75006/pa/HB41504_298b183c956687fb2610385b38ebb9ae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2020}
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB41504%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [auto1.it] INFO: Saving data for HB41504: {'created_time': 1774873539.258548, 'last_price_update_time': 1774873539.258558, 'auction_closing_time': 1774970440.0}
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HB41504') HTTP/1.1" 204 0
2026-03-30 12:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW36955> (referer: https://www.auto1.com/v1/car-details-view/JW36955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0167ea02-5048-5ef4-be06-73da24891139 with identifier: JW36955
2026-03-30 12:25:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167ea02-5048-5ef4-be06-73da24891139 with scrape type 1
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg not downloaded yet
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg not downloaded yet
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg not downloaded yet
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_a23b654a35a63caba4c5948e833c2e5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a23b654a35a63caba4c5948e833c2e5c.jpg not downloaded yet
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_024046df77ff67a1c2d60e5739880e9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_024046df77ff67a1c2d60e5739880e9a.jpg not downloaded yet
2026-03-30 12:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC17055> (referer: https://www.auto1.com/v1/car-details-view/EC17055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_024046df77ff67a1c2d60e5739880e9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-03-30 12:25:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97556c3-224c-5750-89a1-94cea337bb82 with scrape type 1
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d97556c3-224c-5750-89a1-94cea337bb82
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_1b6fd810c039af5fd2aa628516131b0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_89753dbadc53ebb60aa93edd45299555.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_a97f727f4756bf46993cb34eb1e8c176.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_941ec2b76180b4f31fe2bff472321894.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg already downloaded
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Ff1%252F20f133ac545facfe0f2d3070a7ab7428%252Fpa%252FEC17055_075581437f5b575c27c41ca7f22dbb1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg already downloaded
2026-03-30 12:25:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d97556c3-224c-5750-89a1-94cea337bb82, identifier: EC17055
2026-03-30 12:25:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-03-30 12:25:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-03-30 12:25:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055 to the API
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC17055>
{'auction_title': '',
'c_o_2_emission_value': 211,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:46:36Z',
'fuel_type': 'petrol',
'id': 'd97556c3-224c-5750-89a1-94cea337bb82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC17055',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 62219,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg',
'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2003-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 4x4',
'transmission': 'manual',
'trim': '4x4',
'year': 2003}
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC17055%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [auto1.it] INFO: Saving data for EC17055: {'created_time': 1774873540.330852, 'last_price_update_time': 1774873540.330863, 'auction_closing_time': 1774971996.0}
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC17055') HTTP/1.1" 204 0
2026-03-30 12:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a23b654a35a63caba4c5948e833c2e5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT27907> (referer: https://www.auto1.com/v1/car-details-view/JT27907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f602111bcd0>
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_024046df77ff67a1c2d60e5739880e9a.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_024046df77ff67a1c2d60e5739880e9a.jpg saved to cache
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a84310>
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_a23b654a35a63caba4c5948e833c2e5c.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a23b654a35a63caba4c5948e833c2e5c.jpg saved to cache
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a1c668-b18c-574c-b650-8593c51d386b with identifier: JT27907
2026-03-30 12:25:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a1c668-b18c-574c-b650-8593c51d386b with scrape type 1
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7a1c668-b18c-574c-b650-8593c51d386b
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_72d9682da9ca161e49fb293678c07534.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_72d9682da9ca161e49fb293678c07534.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_f19624fece2c0d018e08966c81fea862.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_f19624fece2c0d018e08966c81fea862.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_a8f022efcbd52f8597ca3593aec3e320.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_a8f022efcbd52f8597ca3593aec3e320.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_abddfed5b01f85f7d6a52eb93cdb61ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_abddfed5b01f85f7d6a52eb93cdb61ad.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_9a26d1ee349c4b0eac833dfcb7d4a54c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_9a26d1ee349c4b0eac833dfcb7d4a54c.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_7aaa699319189f761aa1b4d716352af4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_7aaa699319189f761aa1b4d716352af4.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_d4ad54557db0c86a4538d88f912b9799.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_d4ad54557db0c86a4538d88f912b9799.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_b880037af8c26c718c09ad678b7a653b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_b880037af8c26c718c09ad678b7a653b.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_30d8ba1e50fec10be1f732c0c0d9f363.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_30d8ba1e50fec10be1f732c0c0d9f363.jpg already downloaded
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F60%252F4f60d9d9135b3245eedf6df87751456f%252Fpa%252FJT27907_90d92969aefa8c4a0cd7e630e946ff0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_90d92969aefa8c4a0cd7e630e946ff0a.jpg already downloaded
2026-03-30 12:25:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7a1c668-b18c-574c-b650-8593c51d386b, identifier: JT27907
2026-03-30 12:25:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7a1c668-b18c-574c-b650-8593c51d386b with identifier: JT27907
2026-03-30 12:25:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7a1c668-b18c-574c-b650-8593c51d386b with identifier: JT27907
2026-03-30 12:25:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7a1c668-b18c-574c-b650-8593c51d386b with identifier: JT27907 to the API
2026-03-30 12:25:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT27907>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:14:19Z',
'fuel_type': 'diesel',
'id': 'a7a1c668-b18c-574c-b650-8593c51d386b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT27907',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 295981,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_72d9682da9ca161e49fb293678c07534.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_f19624fece2c0d018e08966c81fea862.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_a8f022efcbd52f8597ca3593aec3e320.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_abddfed5b01f85f7d6a52eb93cdb61ad.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_9a26d1ee349c4b0eac833dfcb7d4a54c.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_7aaa699319189f761aa1b4d716352af4.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_d4ad54557db0c86a4538d88f912b9799.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_b880037af8c26c718c09ad678b7a653b.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_30d8ba1e50fec10be1f732c0c0d9f363.jpg',
'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_90d92969aefa8c4a0cd7e630e946ff0a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_72d9682da9ca161e49fb293678c07534.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_f19624fece2c0d018e08966c81fea862.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_a8f022efcbd52f8597ca3593aec3e320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_abddfed5b01f85f7d6a52eb93cdb61ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_9a26d1ee349c4b0eac833dfcb7d4a54c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_7aaa699319189f761aa1b4d716352af4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_d4ad54557db0c86a4538d88f912b9799.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_b880037af8c26c718c09ad678b7a653b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_30d8ba1e50fec10be1f732c0c0d9f363.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7a1c668-b18c-574c-b650-8593c51d386b/a7a1c668-b18c-574c-b650-8593c51d386b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/60/4f60d9d9135b3245eedf6df87751456f/pa/JT27907_90d92969aefa8c4a0cd7e630e946ff0a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
'transmission': 'automatic',
'trim': 'S line Sportpaket',
'year': 2015}
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT27907%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.it] INFO: Saving data for JT27907: {'created_time': 1774873541.152801, 'last_price_update_time': 1774873541.152811, 'auction_closing_time': 1774970059.0}
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JT27907') HTTP/1.1" 204 0
2026-03-30 12:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012819c50>
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg saved to cache
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a468d0>
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg saved to cache
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1f810>
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252Fea%252F4cead06e3809d6ae4b8b0a791c6b0370%252Fpa%252FJW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg saved to cache
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0167ea02-5048-5ef4-be06-73da24891139
2026-03-30 12:25:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0167ea02-5048-5ef4-be06-73da24891139, skipping ID generation
2026-03-30 12:25:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167ea02-5048-5ef4-be06-73da24891139 with scrape type 1
2026-03-30 12:25:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0167ea02-5048-5ef4-be06-73da24891139 sending to next pipeline
2026-03-30 12:25:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0167ea02-5048-5ef4-be06-73da24891139, identifier: JW36955
2026-03-30 12:25:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0167ea02-5048-5ef4-be06-73da24891139 with identifier: JW36955
2026-03-30 12:25:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0167ea02-5048-5ef4-be06-73da24891139 with identifier: JW36955
2026-03-30 12:25:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0167ea02-5048-5ef4-be06-73da24891139 with identifier: JW36955 to the API
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': 'Rental',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:28:46Z',
'fuel_type': 'diesel',
'id': '0167ea02-5048-5ef4-be06-73da24891139',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW36955',
'listing': 'auction',
'location': 'IT, Sassari',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 205602,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a12aadbeb239e0a7814a52e94503ca8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_0b1e1aae6e2472432bb2f8170445a2ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_64a6de62d89b6311f6a7150cbfcbf0f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_a23b654a35a63caba4c5948e833c2e5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0167ea02-5048-5ef4-be06-73da24891139/0167ea02-5048-5ef4-be06-73da24891139_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4c/ea/4cead06e3809d6ae4b8b0a791c6b0370/pa/JW36955_024046df77ff67a1c2d60e5739880e9a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2016}
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW36955%27 HTTP/1.1" 200 None
2026-03-30 12:25:41 [auto1.it] INFO: Saving data for JW36955: {'created_time': 1774873541.969676, 'last_price_update_time': 1774873541.969687, 'auction_closing_time': 1774970926.0}
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW36955') HTTP/1.1" 204 0
2026-03-30 12:25:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 12:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL89401> (referer: https://www.auto1.com/v1/car-details-view/EL89401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a658f5f1-4af4-58ca-ac61-5970fd22c319 with identifier: EL89401
2026-03-30 12:25:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a658f5f1-4af4-58ca-ac61-5970fd22c319 with scrape type 1
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a658f5f1-4af4-58ca-ac61-5970fd22c319
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_8199c5c9bd5cc32eef42d1dc17356800.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_8199c5c9bd5cc32eef42d1dc17356800.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_70a3c56218d57bc65deca67aa83dd035.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_70a3c56218d57bc65deca67aa83dd035.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_f2ece1e420149dd79b0ea83bf913fb24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_f2ece1e420149dd79b0ea83bf913fb24.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_586ca89db32ffc339014d9f45ce3891d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_586ca89db32ffc339014d9f45ce3891d.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_03beb1c605928e55eebb1d21802b7e17.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_03beb1c605928e55eebb1d21802b7e17.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_203ef669ebfb1e1243aad80c4a8bff42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_203ef669ebfb1e1243aad80c4a8bff42.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_3d68b46feb3d03eb2d1f68f967b9c3d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_3d68b46feb3d03eb2d1f68f967b9c3d0.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_e7204a1fdc1449ba2c088a7bded77ec9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_e7204a1fdc1449ba2c088a7bded77ec9.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_13b6f9bed577f5e4d375893028cea200.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_13b6f9bed577f5e4d375893028cea200.jpg already downloaded
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F3c%252Fc13c7cca836337dee42de60ab3b9f63e%252Fpa%252FEL89401_ab48d5afe39b2e9ca358636ae4e09555.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_ab48d5afe39b2e9ca358636ae4e09555.jpg already downloaded
2026-03-30 12:25:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a658f5f1-4af4-58ca-ac61-5970fd22c319, identifier: EL89401
2026-03-30 12:25:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a658f5f1-4af4-58ca-ac61-5970fd22c319 with identifier: EL89401
2026-03-30 12:25:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a658f5f1-4af4-58ca-ac61-5970fd22c319 with identifier: EL89401
2026-03-30 12:25:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a658f5f1-4af4-58ca-ac61-5970fd22c319 with identifier: EL89401 to the API
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL89401>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:24:34Z',
'fuel_type': 'petrol',
'id': 'a658f5f1-4af4-58ca-ac61-5970fd22c319',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL89401',
'listing': 'auction',
'location': 'IT, Tradein',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 146332,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_8199c5c9bd5cc32eef42d1dc17356800.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_70a3c56218d57bc65deca67aa83dd035.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_f2ece1e420149dd79b0ea83bf913fb24.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_586ca89db32ffc339014d9f45ce3891d.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_03beb1c605928e55eebb1d21802b7e17.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_203ef669ebfb1e1243aad80c4a8bff42.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_3d68b46feb3d03eb2d1f68f967b9c3d0.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_e7204a1fdc1449ba2c088a7bded77ec9.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_13b6f9bed577f5e4d375893028cea200.jpg',
'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_ab48d5afe39b2e9ca358636ae4e09555.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_8199c5c9bd5cc32eef42d1dc17356800.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3029487,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_70a3c56218d57bc65deca67aa83dd035.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_f2ece1e420149dd79b0ea83bf913fb24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2059195,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_586ca89db32ffc339014d9f45ce3891d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_03beb1c605928e55eebb1d21802b7e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_203ef669ebfb1e1243aad80c4a8bff42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_3d68b46feb3d03eb2d1f68f967b9c3d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2471322,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_e7204a1fdc1449ba2c088a7bded77ec9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_13b6f9bed577f5e4d375893028cea200.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a658f5f1-4af4-58ca-ac61-5970fd22c319/a658f5f1-4af4-58ca-ac61-5970fd22c319_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2026253,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/3c/c13c7cca836337dee42de60ab3b9f63e/pa/EL89401_ab48d5afe39b2e9ca358636ae4e09555.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2012}
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL89401%27 HTTP/1.1" 200 None
2026-03-30 12:25:42 [auto1.it] INFO: Saving data for EL89401: {'created_time': 1774873542.712707, 'last_price_update_time': 1774873542.712721, 'auction_closing_time': 1774970674.0}
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL89401') HTTP/1.1" 204 0
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS18644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU07793> (referer: https://www.auto1.com/v1/car-details-view/FU07793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with identifier: FU07793
2026-03-30 12:25:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with scrape type 1
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_c515aa57976d5c4986c1e261710de2b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c515aa57976d5c4986c1e261710de2b5.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_150028dca4f6853ea4940c8288a5eedc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_150028dca4f6853ea4940c8288a5eedc.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_36e057d6283749b45c286b52fbfa3faa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_36e057d6283749b45c286b52fbfa3faa.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_c942f9b0218efccbc9f220e9bd631956.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c942f9b0218efccbc9f220e9bd631956.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_44f82477a6e12e19e58c014ac5219d50.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_44f82477a6e12e19e58c014ac5219d50.jpg not downloaded yet
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_664a1ce69d745e3b7c14baf43f0de300.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_664a1ce69d745e3b7c14baf43f0de300.jpg not downloaded yet
2026-03-30 12:25:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP37147> (referer: https://www.auto1.com/v1/car-details-view/DP37147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_277b8657ec9425cf0d810cc17f41e216.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_277b8657ec9425cf0d810cc17f41e216.jpg not downloaded yet
2026-03-30 12:25:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg not downloaded yet
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a9220620046f8e6f821d682c5b648833.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a9220620046f8e6f821d682c5b648833.jpg not downloaded yet
2026-03-30 12:25:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 345bb972-1779-58a2-b2f9-1de758c43ae5 with identifier: DP37147
2026-03-30 12:25:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 345bb972-1779-58a2-b2f9-1de758c43ae5 with scrape type 1
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 345bb972-1779-58a2-b2f9-1de758c43ae5
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_1ce91329c956b7235c57b10fac5f9d0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_1ce91329c956b7235c57b10fac5f9d0d.jpg already downloaded
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_40efcf6f2b7a3af49f9141959f68c89e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_40efcf6f2b7a3af49f9141959f68c89e.jpg already downloaded
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_9f35912c99bc2c236a9800b011c868d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_9f35912c99bc2c236a9800b011c868d3.jpg already downloaded
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_a3f54ddd8bf4fa73b20c1cecb5358a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_a3f54ddd8bf4fa73b20c1cecb5358a4c.jpg already downloaded
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_dc16de907bc6cc7ac1d64f968c71cbf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_dc16de907bc6cc7ac1d64f968c71cbf3.jpg already downloaded
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F38%252Fc4380d6f5f8c5bfb6113bd89f2272be4%252Fpa%252FDP37147_3e71acb0ae5c12e37967d017bc1c6479.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_3e71acb0ae5c12e37967d017bc1c6479.jpg already downloaded
2026-03-30 12:25:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 345bb972-1779-58a2-b2f9-1de758c43ae5, identifier: DP37147
2026-03-30 12:25:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 345bb972-1779-58a2-b2f9-1de758c43ae5 with identifier: DP37147
2026-03-30 12:25:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 345bb972-1779-58a2-b2f9-1de758c43ae5 with identifier: DP37147
2026-03-30 12:25:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 345bb972-1779-58a2-b2f9-1de758c43ae5 with identifier: DP37147 to the API
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP37147>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:49:14Z',
'fuel_type': 'diesel',
'id': '345bb972-1779-58a2-b2f9-1de758c43ae5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP37147',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Honda',
'model': 'Civic',
'odometer': 285299,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_1ce91329c956b7235c57b10fac5f9d0d.jpg',
'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_40efcf6f2b7a3af49f9141959f68c89e.jpg',
'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_9f35912c99bc2c236a9800b011c868d3.jpg',
'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_a3f54ddd8bf4fa73b20c1cecb5358a4c.jpg',
'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_dc16de907bc6cc7ac1d64f968c71cbf3.jpg',
'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_3e71acb0ae5c12e37967d017bc1c6479.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_1ce91329c956b7235c57b10fac5f9d0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_40efcf6f2b7a3af49f9141959f68c89e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_9f35912c99bc2c236a9800b011c868d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_a3f54ddd8bf4fa73b20c1cecb5358a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_dc16de907bc6cc7ac1d64f968c71cbf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345bb972-1779-58a2-b2f9-1de758c43ae5/345bb972-1779-58a2-b2f9-1de758c43ae5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/38/c4380d6f5f8c5bfb6113bd89f2272be4/pa/DP37147_3e71acb0ae5c12e37967d017bc1c6479.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Civic 1.6 DTEC I-DTEC Lifestyle',
'transmission': 'manual',
'trim': 'I-DTEC Lifestyle',
'year': 2013}
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP37147%27 HTTP/1.1" 200 None
2026-03-30 12:25:44 [auto1.it] INFO: Saving data for DP37147: {'created_time': 1774873544.765064, 'last_price_update_time': 1774873544.765075, 'auction_closing_time': 1774972154.0}
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP37147') HTTP/1.1" 204 0
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_664a1ce69d745e3b7c14baf43f0de300.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_277b8657ec9425cf0d810cc17f41e216.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e1ef50>
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_664a1ce69d745e3b7c14baf43f0de300.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_664a1ce69d745e3b7c14baf43f0de300.jpg saved to cache
2026-03-30 12:25:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_44f82477a6e12e19e58c014ac5219d50.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:44 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3584 | hits on page: 40
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010909f90>
2026-03-30 12:25:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg saved to cache
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012bce5d0>
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_277b8657ec9425cf0d810cc17f41e216.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_277b8657ec9425cf0d810cc17f41e216.jpg saved to cache
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:45 [auto1.it] INFO: Found listing with ID: UD26573
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD26573%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Scrape type for UD26573: 2
2026-03-30 12:25:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with identifier: UD26573
2026-03-30 12:25:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b, identifier: UD26573
2026-03-30 12:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a9220620046f8e6f821d682c5b648833.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with identifier: UD26573
2026-03-30 12:25:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with identifier: UD26573
2026-03-30 12:25:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b with identifier: UD26573 to the API
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:01:01Z',
'fuel_type': 'hybrid',
'id': '3e4194c2-f1b3-5c4a-b7d3-42d57ce5a80b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD26573',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 118720,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-13',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD26573%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Saving data for UD26573: {'auction_closing_time': 1774969261.0, 'created_time': 1774083939.201107, 'last_price_update_time': 1774873545.658483}
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD26573') HTTP/1.1" 204 0
2026-03-30 12:25:45 [auto1.it] INFO: Found listing with ID: MP99425
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP99425%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Scrape type for MP99425: 1
2026-03-30 12:25:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c942f9b0218efccbc9f220e9bd631956.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:25:45 [auto1.it] INFO: Found listing with ID: PR90993
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR90993%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Scrape type for PR90993: 1
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010940fd0>
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_44f82477a6e12e19e58c014ac5219d50.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_44f82477a6e12e19e58c014ac5219d50.jpg saved to cache
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a34290>
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a9220620046f8e6f821d682c5b648833.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a9220620046f8e6f821d682c5b648833.jpg saved to cache
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:45 [auto1.it] INFO: Found listing with ID: LS62458
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS62458%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Scrape type for LS62458: 1
2026-03-30 12:25:45 [auto1.it] INFO: Found listing with ID: XH39362
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH39362%27 HTTP/1.1" 200 None
2026-03-30 12:25:45 [auto1.it] INFO: Scrape type for XH39362: 2
2026-03-30 12:25:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c107505-b141-53fb-819e-f815c02e2942 with identifier: XH39362
2026-03-30 12:25:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c107505-b141-53fb-819e-f815c02e2942 with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c107505-b141-53fb-819e-f815c02e2942 with scrape type 2
2026-03-30 12:25:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c107505-b141-53fb-819e-f815c02e2942, identifier: XH39362
2026-03-30 12:25:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c107505-b141-53fb-819e-f815c02e2942 with identifier: XH39362
2026-03-30 12:25:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c107505-b141-53fb-819e-f815c02e2942 with identifier: XH39362
2026-03-30 12:25:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c107505-b141-53fb-819e-f815c02e2942 with identifier: XH39362 to the API
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 165,
'expiration_date': '2026-03-31T15:29:46Z',
'fuel_type': 'petrol',
'id': '9c107505-b141-53fb-819e-f815c02e2942',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH39362',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 17917,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-14',
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2022}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH39362%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.it] INFO: Saving data for XH39362: {'auction_closing_time': 1774970986.0, 'created_time': 1773136070.458879, 'last_price_update_time': 1774873546.316411}
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH39362') HTTP/1.1" 204 0
2026-03-30 12:25:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f87450>
2026-03-30 12:25:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_c942f9b0218efccbc9f220e9bd631956.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c942f9b0218efccbc9f220e9bd631956.jpg saved to cache
2026-03-30 12:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:25:46 [auto1.it] INFO: Found listing with ID: DJ77053
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ77053%27 HTTP/1.1" 200 None
2026-03-30 12:25:46 [auto1.it] INFO: Scrape type for DJ77053: 2
2026-03-30 12:25:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5719e8d0-4387-58fb-91bb-e5a1b56b080d with identifier: DJ77053
2026-03-30 12:25:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5719e8d0-4387-58fb-91bb-e5a1b56b080d with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5719e8d0-4387-58fb-91bb-e5a1b56b080d with scrape type 2
2026-03-30 12:25:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5719e8d0-4387-58fb-91bb-e5a1b56b080d, identifier: DJ77053
2026-03-30 12:25:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5719e8d0-4387-58fb-91bb-e5a1b56b080d with identifier: DJ77053
2026-03-30 12:25:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5719e8d0-4387-58fb-91bb-e5a1b56b080d with identifier: DJ77053
2026-03-30 12:25:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5719e8d0-4387-58fb-91bb-e5a1b56b080d with identifier: DJ77053 to the API
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:44:12Z',
'fuel_type': 'petrol',
'id': '5719e8d0-4387-58fb-91bb-e5a1b56b080d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ77053',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 75074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-26',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2017}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ77053%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Saving data for DJ77053: {'auction_closing_time': 1774971852.0, 'created_time': 1772783942.027035, 'last_price_update_time': 1774873547.058803}
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ77053') HTTP/1.1" 204 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: ZF68362
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF68362%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for ZF68362: 1
2026-03-30 12:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR77304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: EU89254
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU89254%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for EU89254: 1
2026-03-30 12:25:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV57327> (referer: https://www.auto1.com/v1/car-details-view/YV57327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: PX56336
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX56336%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for PX56336: 1
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: VD77416
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: DJ98895
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: AU57625
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: DG51185
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG51185%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for DG51185: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: CS27755
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: YS50306
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: GC16915
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: TT31796
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT31796%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for TT31796: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: EG63290
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: VJ08393
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ08393%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for VJ08393: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: SF67196
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: AB32606
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB32606%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for AB32606: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: US29444
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US29444%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for US29444: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: NN22737
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: XS82719
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: DV11825
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: ME60194
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME60194%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for ME60194: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: CL00266
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: LW39241
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: FL33491
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL33491%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for FL33491: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: UC46466
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: YH22657
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: KJ37946
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ37946%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for KJ37946: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: WR11304
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR11304%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for WR11304: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: UM30901
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM30901%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for UM30901: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: KS72345
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: EG14911
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG14911%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for EG14911: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: DR56605
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR56605%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for DR56605: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: SE55606
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55606%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [auto1.it] INFO: Scrape type for SE55606: 0
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: TP54883
2026-03-30 12:25:47 [auto1.it] INFO: Found listing with ID: UH51209
2026-03-30 12:25:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b31bc52-0420-555f-bf8c-84fde8e3760e with identifier: YV57327
2026-03-30 12:25:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b31bc52-0420-555f-bf8c-84fde8e3760e with scrape type 1
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b31bc52-0420-555f-bf8c-84fde8e3760e
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_37b8c6e7d01eee8add2daf15a2be5434.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_37b8c6e7d01eee8add2daf15a2be5434.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_24d6de0866999db70e3924ff1780116c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_24d6de0866999db70e3924ff1780116c.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_f03d8ddf74c5e1d4e68ee31b303266e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_f03d8ddf74c5e1d4e68ee31b303266e1.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_cfa03df67cd1def9108d2c175dbe025e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_cfa03df67cd1def9108d2c175dbe025e.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_a041006b73b00bda440d7c192c66802e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_a041006b73b00bda440d7c192c66802e.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_bbc041798ec514cd59ad92c0cae2dc33.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bbc041798ec514cd59ad92c0cae2dc33.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_d8e8f46bf46043cc7763e07ad26d3a6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_d8e8f46bf46043cc7763e07ad26d3a6a.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_e3a7d1256f7e5aa853b3a5fcb4171b82.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_e3a7d1256f7e5aa853b3a5fcb4171b82.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_bea4da5c8452fffe455186b94f5c8980.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bea4da5c8452fffe455186b94f5c8980.jpg already downloaded
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Fd1%252F60d15e6d5021d888418d4e7a25cc85c5%252Fpa%252FYV57327_bd525e673e311520d1d0fbc50be2725a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bd525e673e311520d1d0fbc50be2725a.jpg already downloaded
2026-03-30 12:25:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b31bc52-0420-555f-bf8c-84fde8e3760e, identifier: YV57327
2026-03-30 12:25:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b31bc52-0420-555f-bf8c-84fde8e3760e with identifier: YV57327
2026-03-30 12:25:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b31bc52-0420-555f-bf8c-84fde8e3760e with identifier: YV57327
2026-03-30 12:25:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b31bc52-0420-555f-bf8c-84fde8e3760e with identifier: YV57327 to the API
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV57327>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:18:41Z',
'fuel_type': 'diesel',
'id': '8b31bc52-0420-555f-bf8c-84fde8e3760e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV57327',
'listing': 'auction',
'location': 'IT, Caselle',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 202327,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_37b8c6e7d01eee8add2daf15a2be5434.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_24d6de0866999db70e3924ff1780116c.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_f03d8ddf74c5e1d4e68ee31b303266e1.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_cfa03df67cd1def9108d2c175dbe025e.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_a041006b73b00bda440d7c192c66802e.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bbc041798ec514cd59ad92c0cae2dc33.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_d8e8f46bf46043cc7763e07ad26d3a6a.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_e3a7d1256f7e5aa853b3a5fcb4171b82.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bea4da5c8452fffe455186b94f5c8980.jpg',
'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bd525e673e311520d1d0fbc50be2725a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_37b8c6e7d01eee8add2daf15a2be5434.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2242231,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_24d6de0866999db70e3924ff1780116c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_f03d8ddf74c5e1d4e68ee31b303266e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_cfa03df67cd1def9108d2c175dbe025e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_a041006b73b00bda440d7c192c66802e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2341281,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bbc041798ec514cd59ad92c0cae2dc33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_d8e8f46bf46043cc7763e07ad26d3a6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_e3a7d1256f7e5aa853b3a5fcb4171b82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2225589,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bea4da5c8452fffe455186b94f5c8980.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b31bc52-0420-555f-bf8c-84fde8e3760e/8b31bc52-0420-555f-bf8c-84fde8e3760e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326251,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img60/d1/60d15e6d5021d888418d4e7a25cc85c5/pa/YV57327_bd525e673e311520d1d0fbc50be2725a.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Evolve 4WD',
'transmission': 'manual',
'trim': 'Evolve 4WD',
'year': 2013}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV57327%27 HTTP/1.1" 200 None
2026-03-30 12:25:48 [auto1.it] INFO: Saving data for YV57327: {'created_time': 1774873548.05743, 'last_price_update_time': 1774873548.057443, 'auction_closing_time': 1774970321.0}
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV57327') HTTP/1.1" 204 0
2026-03-30 12:25:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL43358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU55217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB58973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU07097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS18644> (referer: https://www.auto1.com/v1/car-details-view/HS18644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbdd69e2-d902-53ee-b476-e0694af39a2e with identifier: HS18644
2026-03-30 12:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbdd69e2-d902-53ee-b476-e0694af39a2e with scrape type 1
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_dcc9c63749bb907048476d09f5dc66b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_dcc9c63749bb907048476d09f5dc66b4.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_2ca6d98ec668c4046c510554f88afa5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_2ca6d98ec668c4046c510554f88afa5d.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_26163f05166b40732cae8b54353d7199.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_26163f05166b40732cae8b54353d7199.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e9cdef024c6407b24fe4eca349f859be.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e9cdef024c6407b24fe4eca349f859be.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_fac6f174676cfaaea68f046674c46863.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_fac6f174676cfaaea68f046674c46863.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e759698e59e2278d9fcfc24073da0bd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e759698e59e2278d9fcfc24073da0bd7.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg not downloaded yet
2026-03-30 12:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF50602> (referer: https://www.auto1.com/v1/car-details-view/GF50602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10fe2632-18ff-5f21-8a9f-9485fe1947ec with identifier: GF50602
2026-03-30 12:25:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec with scrape type 1
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_74021329013b238093ad55539e9dfa29.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_74021329013b238093ad55539e9dfa29.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_5b2b986a9309f03480bfedf260fa0351.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5b2b986a9309f03480bfedf260fa0351.jpg not downloaded yet
2026-03-30 12:25:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_79fe4fe0164cba5027f73963309adbcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79fe4fe0164cba5027f73963309adbcc.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_79cc83664a7743cce341b31dc8b122a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79cc83664a7743cce341b31dc8b122a9.jpg not downloaded yet
2026-03-30 12:25:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa5310>
2026-03-30 12:25:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg saved to cache
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_94904c5f4e1845489b84945906111c1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_94904c5f4e1845489b84945906111c1a.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_a200dfd282c65e2006131eacd7c0ad42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_a200dfd282c65e2006131eacd7c0ad42.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg not downloaded yet
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_909b54d524d5353897af6eb878cebd7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_909b54d524d5353897af6eb878cebd7a.jpg not downloaded yet
2026-03-30 12:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ81655> (referer: https://www.auto1.com/v1/car-details-view/ZZ81655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b3095b9-1459-57f8-aff0-38a6e86d259b with identifier: ZZ81655
2026-03-30 12:25:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b3095b9-1459-57f8-aff0-38a6e86d259b with scrape type 1
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b3095b9-1459-57f8-aff0-38a6e86d259b
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_5996053aa2e283614021945f730fa912.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_5996053aa2e283614021945f730fa912.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_4b29acc82539aa10eb8f24c894d23348.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_4b29acc82539aa10eb8f24c894d23348.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_86acfc7b9f33127e5dc6bb47dd03948c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_86acfc7b9f33127e5dc6bb47dd03948c.jpg already downloaded
2026-03-30 12:25:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_034960dd9e5bc0a4626cbc694a662a80.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_034960dd9e5bc0a4626cbc694a662a80.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_0fabdbb69c993cf403ad7e26f4fb82ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0fabdbb69c993cf403ad7e26f4fb82ec.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_0cfa82b35e60d4b733f58fed99403a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0cfa82b35e60d4b733f58fed99403a72.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_ccfc7615cb64076a6dade3a4794f7ba3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_ccfc7615cb64076a6dade3a4794f7ba3.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_7ad23a2c2c7c721e118067879551e5ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_7ad23a2c2c7c721e118067879551e5ae.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_aa191c54457c3619687cb204813eeb56.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_aa191c54457c3619687cb204813eeb56.jpg already downloaded
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F5b%252F0d5b06c091e60cf1e3eb008a914dcd74%252Fpa%252FZZ81655_3593bd289389def287857500c82e6bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_3593bd289389def287857500c82e6bfc.jpg already downloaded
2026-03-30 12:25:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b3095b9-1459-57f8-aff0-38a6e86d259b, identifier: ZZ81655
2026-03-30 12:25:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b3095b9-1459-57f8-aff0-38a6e86d259b with identifier: ZZ81655
2026-03-30 12:25:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b3095b9-1459-57f8-aff0-38a6e86d259b with identifier: ZZ81655
2026-03-30 12:25:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b3095b9-1459-57f8-aff0-38a6e86d259b with identifier: ZZ81655 to the API
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ81655>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:37:54Z',
'fuel_type': 'diesel',
'id': '0b3095b9-1459-57f8-aff0-38a6e86d259b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ81655',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 443330,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_5996053aa2e283614021945f730fa912.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_4b29acc82539aa10eb8f24c894d23348.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_86acfc7b9f33127e5dc6bb47dd03948c.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_034960dd9e5bc0a4626cbc694a662a80.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0fabdbb69c993cf403ad7e26f4fb82ec.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0cfa82b35e60d4b733f58fed99403a72.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_ccfc7615cb64076a6dade3a4794f7ba3.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_7ad23a2c2c7c721e118067879551e5ae.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_aa191c54457c3619687cb204813eeb56.jpg',
'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_3593bd289389def287857500c82e6bfc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_5996053aa2e283614021945f730fa912.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_4b29acc82539aa10eb8f24c894d23348.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_86acfc7b9f33127e5dc6bb47dd03948c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_034960dd9e5bc0a4626cbc694a662a80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0fabdbb69c993cf403ad7e26f4fb82ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_0cfa82b35e60d4b733f58fed99403a72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_ccfc7615cb64076a6dade3a4794f7ba3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_7ad23a2c2c7c721e118067879551e5ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_aa191c54457c3619687cb204813eeb56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b3095b9-1459-57f8-aff0-38a6e86d259b/0b3095b9-1459-57f8-aff0-38a6e86d259b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0d/5b/0d5b06c091e60cf1e3eb008a914dcd74/pa/ZZ81655_3593bd289389def287857500c82e6bfc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2014}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ81655%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.it] INFO: Saving data for ZZ81655: {'created_time': 1774873556.546845, 'last_price_update_time': 1774873556.546862, 'auction_closing_time': 1774971474.0}
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ81655') HTTP/1.1" 204 0
2026-03-30 12:25:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_a200dfd282c65e2006131eacd7c0ad42.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_909b54d524d5353897af6eb878cebd7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc4890>
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg saved to cache
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f2b990>
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg saved to cache
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f7ae10>
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_a200dfd282c65e2006131eacd7c0ad42.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_a200dfd282c65e2006131eacd7c0ad42.jpg saved to cache
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a39a10>
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_909b54d524d5353897af6eb878cebd7a.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_909b54d524d5353897af6eb878cebd7a.jpg saved to cache
2026-03-30 12:25:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:56 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3584 | hits on page: 40
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: WL93075
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: LU79948
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU79948%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.it] INFO: Scrape type for LU79948: 0
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: JN50634
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: XN71458
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: AX59226
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX59226%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.it] INFO: Scrape type for AX59226: 0
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: BS95687
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: PE32711
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: LR70386
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: XY37684
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: NA99278
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA99278%27 HTTP/1.1" 200 None
2026-03-30 12:25:56 [auto1.it] INFO: Scrape type for NA99278: 0
2026-03-30 12:25:56 [auto1.it] INFO: Found listing with ID: FD34465
2026-03-30 12:25:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD34465%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for FD34465: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TT47186
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: RX48220
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TF73958
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TM12989
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: DH32592
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH32592%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for DH32592: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: RD99785
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: ER70142
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: XW57300
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW57300%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for XW57300: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: AR14989
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR14989%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for AR14989: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: XY74656
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: XF75948
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75948%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for XF75948: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: BJ45035
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ45035%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for BJ45035: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: XU90794
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: XZ58879
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ58879%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for XZ58879: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: PM75011
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TB20561
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: EM68882
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: VJ71364
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: GD09579
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD09579%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for GD09579: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: RA79730
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: KC51409
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC51409%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for KC51409: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: PT97539
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT97539%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for PT97539: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: BT13926
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TF50576
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF50576%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for TF50576: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: YW32826
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW32826%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for YW32826: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: AD37859
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: TW08146
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW08146%27 HTTP/1.1" 200 None
2026-03-30 12:25:57 [auto1.it] INFO: Scrape type for TW08146: 0
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: DR91409
2026-03-30 12:25:57 [auto1.it] INFO: Found listing with ID: BP95163
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_94904c5f4e1845489b84945906111c1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP99425/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:25:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5b2b986a9309f03480bfedf260fa0351.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fcc950>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010939150>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_94904c5f4e1845489b84945906111c1a.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_94904c5f4e1845489b84945906111c1a.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_74021329013b238093ad55539e9dfa29.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601170c090>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79fe4fe0164cba5027f73963309adbcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b002d0>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_5b2b986a9309f03480bfedf260fa0351.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5b2b986a9309f03480bfedf260fa0351.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3f090>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_74021329013b238093ad55539e9dfa29.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_74021329013b238093ad55539e9dfa29.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79cc83664a7743cce341b31dc8b122a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127ce350>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_79fe4fe0164cba5027f73963309adbcc.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79fe4fe0164cba5027f73963309adbcc.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_fac6f174676cfaaea68f046674c46863.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e9cdef024c6407b24fe4eca349f859be.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e26290>
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fee%252Fe4ee529cb03f2c79691cba1b1a9955bb%252Fpa%252FGF50602_79cc83664a7743cce341b31dc8b122a9.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79cc83664a7743cce341b31dc8b122a9.jpg saved to cache
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec
2026-03-30 12:25:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10fe2632-18ff-5f21-8a9f-9485fe1947ec, skipping ID generation
2026-03-30 12:25:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec with scrape type 1
2026-03-30 12:25:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10fe2632-18ff-5f21-8a9f-9485fe1947ec sending to next pipeline
2026-03-30 12:25:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10fe2632-18ff-5f21-8a9f-9485fe1947ec, identifier: GF50602
2026-03-30 12:25:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10fe2632-18ff-5f21-8a9f-9485fe1947ec with identifier: GF50602
2026-03-30 12:25:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10fe2632-18ff-5f21-8a9f-9485fe1947ec with identifier: GF50602
2026-03-30 12:25:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10fe2632-18ff-5f21-8a9f-9485fe1947ec with identifier: GF50602 to the API
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79cc83664a7743cce341b31dc8b122a9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:04:05Z',
'fuel_type': 'diesel',
'id': '10fe2632-18ff-5f21-8a9f-9485fe1947ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF50602',
'listing': 'auction',
'location': 'IT, Camerano (AN)',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 199101,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_74021329013b238093ad55539e9dfa29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5b2b986a9309f03480bfedf260fa0351.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79fe4fe0164cba5027f73963309adbcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_5d7fbdfb8799404ab0ce4a9c84b2d9d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_79cc83664a7743cce341b31dc8b122a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_94904c5f4e1845489b84945906111c1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_8509f93a2c0cdfef6c5f8245d0bfdea2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_a200dfd282c65e2006131eacd7c0ad42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_2cbf8c3cbd5c0cc122f0446dadb90cd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10fe2632-18ff-5f21-8a9f-9485fe1947ec/10fe2632-18ff-5f21-8a9f-9485fe1947ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/ee/e4ee529cb03f2c79691cba1b1a9955bb/pa/GF50602_909b54d524d5353897af6eb878cebd7a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
'transmission': 'automatic',
'trim': 'INNOVATION',
'year': 2020}
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF50602%27 HTTP/1.1" 200 None
2026-03-30 12:25:58 [auto1.it] INFO: Saving data for GF50602: {'created_time': 1774873558.326463, 'last_price_update_time': 1774873558.326474, 'auction_closing_time': 1774969445.0}
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GF50602') HTTP/1.1" 204 0
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091ea90>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_fac6f174676cfaaea68f046674c46863.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_fac6f174676cfaaea68f046674c46863.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127ce210>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e9cdef024c6407b24fe4eca349f859be.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e9cdef024c6407b24fe4eca349f859be.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b05d90>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_26163f05166b40732cae8b54353d7199.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a87f90>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_26163f05166b40732cae8b54353d7199.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_26163f05166b40732cae8b54353d7199.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_2ca6d98ec668c4046c510554f88afa5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa4890>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_dcc9c63749bb907048476d09f5dc66b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f99550>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_2ca6d98ec668c4046c510554f88afa5d.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_2ca6d98ec668c4046c510554f88afa5d.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e759698e59e2278d9fcfc24073da0bd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60127ce650>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_dcc9c63749bb907048476d09f5dc66b4.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_dcc9c63749bb907048476d09f5dc66b4.jpg saved to cache
2026-03-30 12:25:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb8d90>
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:25:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:25:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F09%252F1d09c3f2d79943f674e25f8c98796e17%252Fpa%252FHS18644_e759698e59e2278d9fcfc24073da0bd7.jpg') HTTP/1.1" 204 0
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e759698e59e2278d9fcfc24073da0bd7.jpg saved to cache
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbdd69e2-d902-53ee-b476-e0694af39a2e
2026-03-30 12:25:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbdd69e2-d902-53ee-b476-e0694af39a2e, skipping ID generation
2026-03-30 12:25:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbdd69e2-d902-53ee-b476-e0694af39a2e with scrape type 1
2026-03-30 12:25:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbdd69e2-d902-53ee-b476-e0694af39a2e sending to next pipeline
2026-03-30 12:25:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbdd69e2-d902-53ee-b476-e0694af39a2e, identifier: HS18644
2026-03-30 12:25:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbdd69e2-d902-53ee-b476-e0694af39a2e with identifier: HS18644
2026-03-30 12:25:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbdd69e2-d902-53ee-b476-e0694af39a2e with identifier: HS18644
2026-03-30 12:25:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbdd69e2-d902-53ee-b476-e0694af39a2e with identifier: HS18644 to the API
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:25:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e759698e59e2278d9fcfc24073da0bd7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:48:15Z',
'fuel_type': 'diesel',
'id': 'bbdd69e2-d902-53ee-b476-e0694af39a2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS18644',
'listing': 'auction',
'location': 'IT',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 142875,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_dcc9c63749bb907048476d09f5dc66b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111932,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_2ca6d98ec668c4046c510554f88afa5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_b0b87696ea1bffae7ec3e7d2c21ce7d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_26163f05166b40732cae8b54353d7199.jpg',
'Width': 730},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e1528a7561c099f2eb7c19c0230ed98c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e9cdef024c6407b24fe4eca349f859be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_fac6f174676cfaaea68f046674c46863.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2885064,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e759698e59e2278d9fcfc24073da0bd7.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027644,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_d408050bc3977401f5b3a5a1e6d7081f.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbdd69e2-d902-53ee-b476-e0694af39a2e/bbdd69e2-d902-53ee-b476-e0694af39a2e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/09/1d09c3f2d79943f674e25f8c98796e17/pa/HS18644_e95ff965039d9a62c89cc48ec6aadd0c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar E-Pace D150 AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2018}
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS18644%27 HTTP/1.1" 200 None
2026-03-30 12:25:59 [auto1.it] INFO: Saving data for HS18644: {'created_time': 1774873559.700537, 'last_price_update_time': 1774873559.700548, 'auction_closing_time': 1774972095.0}
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:25:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HS18644') HTTP/1.1" 204 0
2026-03-30 12:26:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.822(s), this was the 1st time calling it.
2026-03-30 12:26:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.999724098960834 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:26:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU89254/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL35572/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:04 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 33 pages/min), scraped 106 items (at 17 items/min)
2026-03-30 12:26:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:26:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF68362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL43358> (referer: https://www.auto1.com/v1/car-details-view/KL43358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with identifier: KL43358
2026-03-30 12:26:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with scrape type 1
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_5e3589ad4cdb220d64d55246538b12dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5e3589ad4cdb220d64d55246538b12dc.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_863a15eef827d8ed88b5417f62962f6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_863a15eef827d8ed88b5417f62962f6a.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_afc229040d6ea00da513e552673d5db7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_afc229040d6ea00da513e552673d5db7.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_97f932082592c2cad0e7df04f30d9c57.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_97f932082592c2cad0e7df04f30d9c57.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_8c739f1d11258754c87e9bb0b31916d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8c739f1d11258754c87e9bb0b31916d3.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_58ba9de601ca995f54c8bbbced32f476.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58ba9de601ca995f54c8bbbced32f476.jpg not downloaded yet
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg not downloaded yet
2026-03-30 12:26:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB58973> (referer: https://www.auto1.com/v1/car-details-view/EB58973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-03-30 12:26:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 with scrape type 1
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_69371794c3dac706d64ab35247842559.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_2d9405c831fab16439eda933ed35accf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_57f13357aac8686d8183120379aae445.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg not downloaded yet
2026-03-30 12:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_225a9bf48f463318e7e383f47d99fdac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_897a2ac450c9384b5c1368b962b44b92.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg not downloaded yet
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_205c219908a2bd21394ff6d0256e4a05.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg not downloaded yet
2026-03-30 12:26:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010938610>
2026-03-30 12:26:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg saved to cache
2026-03-30 12:26:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091fd50>
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg saved to cache
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f38bd0>
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_205c219908a2bd21394ff6d0256e4a05.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg saved to cache
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f69ed0>
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_897a2ac450c9384b5c1368b962b44b92.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg saved to cache
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc5310>
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_225a9bf48f463318e7e383f47d99fdac.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg saved to cache
2026-03-30 12:26:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a61fd0>
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg saved to cache
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fec510>
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg saved to cache
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b02e90>
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_57f13357aac8686d8183120379aae445.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg saved to cache
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010938850>
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_2d9405c831fab16439eda933ed35accf.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg saved to cache
2026-03-30 12:26:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a44a50>
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg saved to cache
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58ba9de601ca995f54c8bbbced32f476.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012aff790>
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F16%252Fc91622e2ba21869a56b5e09a58de8e14%252Fpa%252FEB58973_69371794c3dac706d64ab35247842559.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg saved to cache
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-03-30 12:26:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fbfba57-3031-5043-bf96-7654e89d6ce0, skipping ID generation
2026-03-30 12:26:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 with scrape type 1
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 sending to next pipeline
2026-03-30 12:26:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fbfba57-3031-5043-bf96-7654e89d6ce0, identifier: EB58973
2026-03-30 12:26:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-03-30 12:26:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-03-30 12:26:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973 to the API
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:35:02Z',
'fuel_type': 'diesel',
'id': '8fbfba57-3031-5043-bf96-7654e89d6ce0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB58973',
'listing': 'auction',
'location': 'IT, Torino',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 141986,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2112016,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1776401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2283101,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB58973%27 HTTP/1.1" 200 None
2026-03-30 12:26:13 [auto1.it] INFO: Saving data for EB58973: {'created_time': 1774873573.90413, 'last_price_update_time': 1774873573.904142, 'auction_closing_time': 1774971302.0}
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB58973') HTTP/1.1" 204 0
2026-03-30 12:26:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8c739f1d11258754c87e9bb0b31916d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601170c910>
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_58ba9de601ca995f54c8bbbced32f476.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58ba9de601ca995f54c8bbbced32f476.jpg saved to cache
2026-03-30 12:26:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f70890>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_8c739f1d11258754c87e9bb0b31916d3.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8c739f1d11258754c87e9bb0b31916d3.jpg saved to cache
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60109578d0>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg saved to cache
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_97f932082592c2cad0e7df04f30d9c57.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3d690>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_97f932082592c2cad0e7df04f30d9c57.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_97f932082592c2cad0e7df04f30d9c57.jpg saved to cache
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_afc229040d6ea00da513e552673d5db7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a55290>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_afc229040d6ea00da513e552673d5db7.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_afc229040d6ea00da513e552673d5db7.jpg saved to cache
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a61490>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg saved to cache
2026-03-30 12:26:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a57250>
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg saved to cache
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_863a15eef827d8ed88b5417f62962f6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5e3589ad4cdb220d64d55246538b12dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_36e057d6283749b45c286b52fbfa3faa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3fc50>
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_863a15eef827d8ed88b5417f62962f6a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_863a15eef827d8ed88b5417f62962f6a.jpg saved to cache
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f73fd0>
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F88%252F5188b87726eddefa62bcac7180ea11c7%252Fpa%252FKL43358_5e3589ad4cdb220d64d55246538b12dc.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5e3589ad4cdb220d64d55246538b12dc.jpg saved to cache
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a
2026-03-30 12:26:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a, skipping ID generation
2026-03-30 12:26:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with scrape type 1
2026-03-30 12:26:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a sending to next pipeline
2026-03-30 12:26:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a, identifier: KL43358
2026-03-30 12:26:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with identifier: KL43358
2026-03-30 12:26:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with identifier: KL43358
2026-03-30 12:26:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a with identifier: KL43358 to the API
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5e3589ad4cdb220d64d55246538b12dc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:08:12Z',
'fuel_type': 'petrol',
'id': '5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL43358',
'listing': 'auction',
'location': 'IT, Villasanta',
'make': 'Renault',
'model': 'Clio',
'odometer': 45038,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5e3589ad4cdb220d64d55246538b12dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_863a15eef827d8ed88b5417f62962f6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8127344c4f33b227e1e9bdf21ae9ad78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_d2cb3f094c88669d3e5b92a2f6ea0d1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_afc229040d6ea00da513e552673d5db7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_97f932082592c2cad0e7df04f30d9c57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58b5f28ee85d79da842e03dcdf6e95cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_8c739f1d11258754c87e9bb0b31916d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_58ba9de601ca995f54c8bbbced32f476.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a/5cd9a8f0-d30e-5f52-8efd-2c7ba0bad25a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/88/5188b87726eddefa62bcac7180ea11c7/pa/KL43358_5ec27e0f1a592e4fb36401906ae0e0f4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-08',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 0.9 TCe Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2019}
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL43358%27 HTTP/1.1" 200 None
2026-03-30 12:26:16 [auto1.it] INFO: Saving data for KL43358: {'created_time': 1774873576.072489, 'last_price_update_time': 1774873576.072501, 'auction_closing_time': 1774969692.0}
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KL43358') HTTP/1.1" 204 0
2026-03-30 12:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108db2d0>
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_36e057d6283749b45c286b52fbfa3faa.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_36e057d6283749b45c286b52fbfa3faa.jpg saved to cache
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fce3d0>
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg saved to cache
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_150028dca4f6853ea4940c8288a5eedc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c515aa57976d5c4986c1e261710de2b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e05ed0>
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_150028dca4f6853ea4940c8288a5eedc.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_150028dca4f6853ea4940c8288a5eedc.jpg saved to cache
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012aff750>
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F37%252F3f37688f6c1d1ee7f1fcd52c3cc45421%252Fpa%252FFU07793_c515aa57976d5c4986c1e261710de2b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c515aa57976d5c4986c1e261710de2b5.jpg saved to cache
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e
2026-03-30 12:26:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e, skipping ID generation
2026-03-30 12:26:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with scrape type 1
2026-03-30 12:26:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cfaaa99-4b88-5ce7-b337-01d2efabd75e sending to next pipeline
2026-03-30 12:26:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e, identifier: FU07793
2026-03-30 12:26:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with identifier: FU07793
2026-03-30 12:26:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with identifier: FU07793
2026-03-30 12:26:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8cfaaa99-4b88-5ce7-b337-01d2efabd75e with identifier: FU07793 to the API
2026-03-30 12:26:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c515aa57976d5c4986c1e261710de2b5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:50:08Z',
'fuel_type': 'hybrid',
'id': '8cfaaa99-4b88-5ce7-b337-01d2efabd75e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU07793',
'listing': 'auction',
'location': 'IT, Agnano (NA)',
'make': 'Peugeot',
'model': '408',
'odometer': 34430,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c515aa57976d5c4986c1e261710de2b5.jpg',
'Width': 760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_150028dca4f6853ea4940c8288a5eedc.jpg',
'Width': 760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7f00a8afdba924ce4e3b7e280a06603.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_36e057d6283749b45c286b52fbfa3faa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_c942f9b0218efccbc9f220e9bd631956.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_44f82477a6e12e19e58c014ac5219d50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_664a1ce69d745e3b7c14baf43f0de300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_277b8657ec9425cf0d810cc17f41e216.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a7bd3de937f036e1bf0d95d85fb4e7bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cfaaa99-4b88-5ce7-b337-01d2efabd75e/8cfaaa99-4b88-5ce7-b337-01d2efabd75e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/37/3f37688f6c1d1ee7f1fcd52c3cc45421/pa/FU07793_a9220620046f8e6f821d682c5b648833.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 408 1.6 Hybrid GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2024}
2026-03-30 12:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU07793%27 HTTP/1.1" 200 None
2026-03-30 12:26:17 [auto1.it] INFO: Saving data for FU07793: {'created_time': 1774873577.119015, 'last_price_update_time': 1774873577.11903, 'auction_closing_time': 1774972208.0}
2026-03-30 12:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FU07793') HTTP/1.1" 204 0
2026-03-30 12:26:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV44549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU55217> (referer: https://www.auto1.com/v1/car-details-view/DU55217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with identifier: DU55217
2026-03-30 12:26:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with scrape type 1
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_de405866d73ec48b32d7e8153664fd6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_de405866d73ec48b32d7e8153664fd6d.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_85549e3dec2b2f24ad5775f956c1773a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_85549e3dec2b2f24ad5775f956c1773a.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_46c285f567bb693849ab1c4eda157380.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_46c285f567bb693849ab1c4eda157380.jpg not downloaded yet
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_29b9a6111b432b76694ebecf6e029807.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_29b9a6111b432b76694ebecf6e029807.jpg not downloaded yet
2026-03-30 12:26:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP99425> (referer: https://www.auto1.com/v1/car-details-view/MP99425/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aaa4705-440b-5c7e-9ce7-53eee61c4641 with identifier: MP99425
2026-03-30 12:26:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aaa4705-440b-5c7e-9ce7-53eee61c4641 with scrape type 1
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8aaa4705-440b-5c7e-9ce7-53eee61c4641
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_399f82856455c6c18fcefc0640b87e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_399f82856455c6c18fcefc0640b87e79.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_f051debd53f59d02c4f72d04045d490d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_f051debd53f59d02c4f72d04045d490d.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_215c08004c2d18cf6ec0f2e33d0a4d24.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_215c08004c2d18cf6ec0f2e33d0a4d24.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_2e43859a6c84f4a2c3030f79169068c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2e43859a6c84f4a2c3030f79169068c7.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_17b45ad9df251859a0fbdff4accc0c8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_17b45ad9df251859a0fbdff4accc0c8a.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_6983533e576bc21bbdc39cbea2798866.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_6983533e576bc21bbdc39cbea2798866.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_c54e52aca8706a61fcbd37043ae5db64.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c54e52aca8706a61fcbd37043ae5db64.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_c1a6236c27223742586aaf560af3f9bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c1a6236c27223742586aaf560af3f9bd.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_2252ea7b65be35ec830156ef49eb89c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2252ea7b65be35ec830156ef49eb89c1.jpg already downloaded
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252Fc9%252F21c976b7d72dadc04444892469985c47%252Fpa%252FMP99425_441d9c3293ddcfc340a78b2b8547e7e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_441d9c3293ddcfc340a78b2b8547e7e1.jpg already downloaded
2026-03-30 12:26:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8aaa4705-440b-5c7e-9ce7-53eee61c4641, identifier: MP99425
2026-03-30 12:26:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8aaa4705-440b-5c7e-9ce7-53eee61c4641 with identifier: MP99425
2026-03-30 12:26:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8aaa4705-440b-5c7e-9ce7-53eee61c4641 with identifier: MP99425
2026-03-30 12:26:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8aaa4705-440b-5c7e-9ce7-53eee61c4641 with identifier: MP99425 to the API
2026-03-30 12:26:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP99425>
{'auction_title': '',
'c_o_2_emission_value': 185,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.9L',
'engine_horse_power': 330,
'expiration_date': '2026-03-31T15:01:33Z',
'fuel_type': 'diesel',
'id': '8aaa4705-440b-5c7e-9ce7-53eee61c4641',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP99425',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 61622,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_399f82856455c6c18fcefc0640b87e79.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_f051debd53f59d02c4f72d04045d490d.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_215c08004c2d18cf6ec0f2e33d0a4d24.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2e43859a6c84f4a2c3030f79169068c7.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_17b45ad9df251859a0fbdff4accc0c8a.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_6983533e576bc21bbdc39cbea2798866.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c54e52aca8706a61fcbd37043ae5db64.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c1a6236c27223742586aaf560af3f9bd.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2252ea7b65be35ec830156ef49eb89c1.jpg',
'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_441d9c3293ddcfc340a78b2b8547e7e1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_399f82856455c6c18fcefc0640b87e79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_f051debd53f59d02c4f72d04045d490d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_215c08004c2d18cf6ec0f2e33d0a4d24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2e43859a6c84f4a2c3030f79169068c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_17b45ad9df251859a0fbdff4accc0c8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_6983533e576bc21bbdc39cbea2798866.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c54e52aca8706a61fcbd37043ae5db64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_c1a6236c27223742586aaf560af3f9bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_2252ea7b65be35ec830156ef49eb89c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aaa4705-440b-5c7e-9ce7-53eee61c4641/8aaa4705-440b-5c7e-9ce7-53eee61c4641_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/c9/21c976b7d72dadc04444892469985c47/pa/MP99425_441d9c3293ddcfc340a78b2b8547e7e1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-03',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2022}
2026-03-30 12:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP99425%27 HTTP/1.1" 200 None
2026-03-30 12:26:22 [auto1.it] INFO: Saving data for MP99425: {'created_time': 1774873582.886736, 'last_price_update_time': 1774873582.886747, 'auction_closing_time': 1774969293.0}
2026-03-30 12:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP99425') HTTP/1.1" 204 0
2026-03-30 12:26:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_29b9a6111b432b76694ebecf6e029807.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3fbd0>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_29b9a6111b432b76694ebecf6e029807.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_29b9a6111b432b76694ebecf6e029807.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_46c285f567bb693849ab1c4eda157380.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fcd710>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_46c285f567bb693849ab1c4eda157380.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_46c285f567bb693849ab1c4eda157380.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f70150>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_85549e3dec2b2f24ad5775f956c1773a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff61d0>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_85549e3dec2b2f24ad5775f956c1773a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_85549e3dec2b2f24ad5775f956c1773a.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e06610>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b05850>
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg saved to cache
2026-03-30 12:26:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_de405866d73ec48b32d7e8153664fd6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fceb10>
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_de405866d73ec48b32d7e8153664fd6d.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_de405866d73ec48b32d7e8153664fd6d.jpg saved to cache
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108db8d0>
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg saved to cache
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e25150>
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg saved to cache
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108d8dd0>
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F89%252Ff48960494c63105c272511a0eb9bff7c%252Fpa%252FDU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg saved to cache
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3
2026-03-30 12:26:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3, skipping ID generation
2026-03-30 12:26:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with scrape type 1
2026-03-30 12:26:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 sending to next pipeline
2026-03-30 12:26:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3, identifier: DU55217
2026-03-30 12:26:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with identifier: DU55217
2026-03-30 12:26:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with identifier: DU55217
2026-03-30 12:26:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0994edbf-99d9-5fa1-b8f0-31a9f73674a3 with identifier: DU55217 to the API
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 129,
'expiration_date': '2026-03-31T15:53:45Z',
'fuel_type': 'petrol',
'id': '0994edbf-99d9-5fa1-b8f0-31a9f73674a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU55217',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'Jeep',
'model': 'Avenger',
'odometer': 12148,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_2db13bbd2eef21a752ddb3228b598c7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_6e41b8f98e5a1d208b4b0622f3511463.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_f7dc07d58aa44425543a2b4e0b3f1b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_de405866d73ec48b32d7e8153664fd6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_86a66c14f2efda251efa5229c4fa9a3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_fd307ac4f175ddc1fd5abeb0043aa41a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_85549e3dec2b2f24ad5775f956c1773a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_e1f624cc22cb8010c8146de8eaec7b0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_46c285f567bb693849ab1c4eda157380.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0994edbf-99d9-5fa1-b8f0-31a9f73674a3/0994edbf-99d9-5fa1-b8f0-31a9f73674a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/89/f48960494c63105c272511a0eb9bff7c/pa/DU55217_29b9a6111b432b76694ebecf6e029807.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Avenger 1.2 T3 Mild-Hybrid Longitude',
'transmission': 'automatic',
'trim': 'Longitude',
'year': 2024}
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU55217%27 HTTP/1.1" 200 None
2026-03-30 12:26:24 [auto1.it] INFO: Saving data for DU55217: {'created_time': 1774873584.984986, 'last_price_update_time': 1774873584.984997, 'auction_closing_time': 1774972425.0}
2026-03-30 12:26:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU55217') HTTP/1.1" 204 0
2026-03-30 12:26:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX56336/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP50044> (referer: https://www.auto1.com/v1/car-details-view/NP50044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with identifier: NP50044
2026-03-30 12:26:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with scrape type 1
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_3604c717da927cbc550f85b198c2846d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3604c717da927cbc550f85b198c2846d.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_bfb169420aae323f963ebec7b33a808c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_bfb169420aae323f963ebec7b33a808c.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_a4931a5c216cf2560caad4b91325c792.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_a4931a5c216cf2560caad4b91325c792.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_d4caa1a3e66345b3e69e921515a0b946.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_d4caa1a3e66345b3e69e921515a0b946.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_e2c273dda8937df3aee1337398d8ca09.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_e2c273dda8937df3aee1337398d8ca09.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_2cb576a66fa424495304d2b28952d061.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_2cb576a66fa424495304d2b28952d061.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_dd0855a48961226c6ef39b80af4fa27a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_dd0855a48961226c6ef39b80af4fa27a.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_36fc900116fddefb19e5d5e4689c0471.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_36fc900116fddefb19e5d5e4689c0471.jpg not downloaded yet
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg not downloaded yet
2026-03-30 12:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR90993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6b690>
2026-03-30 12:26:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg saved to cache
2026-03-30 12:26:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL35572> (referer: https://www.auto1.com/v1/car-details-view/EL35572/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8881a3d1-98f4-500b-b83a-bca81064a615 with identifier: EL35572
2026-03-30 12:26:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8881a3d1-98f4-500b-b83a-bca81064a615 with scrape type 1
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_b75b5c84ec50c7706069b711809ba827.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_b75b5c84ec50c7706069b711809ba827.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_af8df02466c31e474bd1e076b9c04af4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_af8df02466c31e474bd1e076b9c04af4.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg not downloaded yet
2026-03-30 12:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_36fc900116fddefb19e5d5e4689c0471.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_81f35eabc20409776a912971c7bd2683.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_81f35eabc20409776a912971c7bd2683.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_98841e66b3c8feec1f015eb1eeee892f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_98841e66b3c8feec1f015eb1eeee892f.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg not downloaded yet
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg not downloaded yet
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb9790>
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_36fc900116fddefb19e5d5e4689c0471.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_36fc900116fddefb19e5d5e4689c0471.jpg saved to cache
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601170ca90>
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg saved to cache
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb8f10>
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg saved to cache
2026-03-30 12:26:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fcf390>
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091f8d0>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_98841e66b3c8feec1f015eb1eeee892f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV35786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:26:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012ce6510>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_98841e66b3c8feec1f015eb1eeee892f.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_98841e66b3c8feec1f015eb1eeee892f.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_af8df02466c31e474bd1e076b9c04af4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_81f35eabc20409776a912971c7bd2683.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a47490>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_af8df02466c31e474bd1e076b9c04af4.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_af8df02466c31e474bd1e076b9c04af4.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3d1d0>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_81f35eabc20409776a912971c7bd2683.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_81f35eabc20409776a912971c7bd2683.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f516d0>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e05f10>
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg saved to cache
2026-03-30 12:26:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_b75b5c84ec50c7706069b711809ba827.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:26:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 12:26:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:26:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa6c50>
2026-03-30 12:26:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:26:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F5c%252Fc55c5332d86f0c6977ce0ae70b9f8b25%252Fpa%252FEL35572_b75b5c84ec50c7706069b711809ba827.jpg') HTTP/1.1" 204 0
2026-03-30 12:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_b75b5c84ec50c7706069b711809ba827.jpg saved to cache
2026-03-30 12:26:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8881a3d1-98f4-500b-b83a-bca81064a615
2026-03-30 12:26:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8881a3d1-98f4-500b-b83a-bca81064a615, skipping ID generation
2026-03-30 12:26:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8881a3d1-98f4-500b-b83a-bca81064a615 with scrape type 1
2026-03-30 12:26:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8881a3d1-98f4-500b-b83a-bca81064a615 sending to next pipeline
2026-03-30 12:26:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8881a3d1-98f4-500b-b83a-bca81064a615, identifier: EL35572
2026-03-30 12:26:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8881a3d1-98f4-500b-b83a-bca81064a615 with identifier: EL35572
2026-03-30 12:26:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8881a3d1-98f4-500b-b83a-bca81064a615 with identifier: EL35572
2026-03-30 12:26:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8881a3d1-98f4-500b-b83a-bca81064a615 with identifier: EL35572 to the API
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:26:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_b75b5c84ec50c7706069b711809ba827.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:45:57Z',
'fuel_type': 'diesel',
'id': '8881a3d1-98f4-500b-b83a-bca81064a615',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL35572',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'Dacia',
'model': 'Duster',
'odometer': 139111,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928777,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_b75b5c84ec50c7706069b711809ba827.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_06d3541ee7581e4bf2f0fb43d5e813f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_1d8f509a99b2838eb06e33fdbe96b169.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_af8df02466c31e474bd1e076b9c04af4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_88cf50963a0f8f0cd27f1ee1f6da12d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848163,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_81f35eabc20409776a912971c7bd2683.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_98841e66b3c8feec1f015eb1eeee892f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_cb203bb528f212510fd49cfa1e7bc4ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1952724,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_ff61b47754a8df8239d3935fc59fc3c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8881a3d1-98f4-500b-b83a-bca81064a615/8881a3d1-98f4-500b-b83a-bca81064a615_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/5c/c55c5332d86f0c6977ce0ae70b9f8b25/pa/EL35572_2af91e6555ff1354dba0b1ff590e25bb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2016}
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:26:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL35572%27 HTTP/1.1" 200 None
2026-03-30 12:26:59 [auto1.it] INFO: Saving data for EL35572: {'created_time': 1774873619.997776, 'last_price_update_time': 1774873619.997787, 'auction_closing_time': 1774971957.0}
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EL35572') HTTP/1.1" 204 0
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_dd0855a48961226c6ef39b80af4fa27a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3a590>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_dd0855a48961226c6ef39b80af4fa27a.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_dd0855a48961226c6ef39b80af4fa27a.jpg saved to cache
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_2cb576a66fa424495304d2b28952d061.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012850b10>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_2cb576a66fa424495304d2b28952d061.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_2cb576a66fa424495304d2b28952d061.jpg saved to cache
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_e2c273dda8937df3aee1337398d8ca09.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fbb090>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_e2c273dda8937df3aee1337398d8ca09.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_e2c273dda8937df3aee1337398d8ca09.jpg saved to cache
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_d4caa1a3e66345b3e69e921515a0b946.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f387d0>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_d4caa1a3e66345b3e69e921515a0b946.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_d4caa1a3e66345b3e69e921515a0b946.jpg saved to cache
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_a4931a5c216cf2560caad4b91325c792.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fecf50>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_a4931a5c216cf2560caad4b91325c792.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_a4931a5c216cf2560caad4b91325c792.jpg saved to cache
2026-03-30 12:27:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3bfd0>
2026-03-30 12:27:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg saved to cache
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_bfb169420aae323f963ebec7b33a808c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8da50>
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_bfb169420aae323f963ebec7b33a808c.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_bfb169420aae323f963ebec7b33a808c.jpg saved to cache
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3604c717da927cbc550f85b198c2846d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a46050>
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616a3de56da469e8c941e0220149424%252Fpa%252FNP50044_3604c717da927cbc550f85b198c2846d.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3604c717da927cbc550f85b198c2846d.jpg saved to cache
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31
2026-03-30 12:27:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31, skipping ID generation
2026-03-30 12:27:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with scrape type 1
2026-03-30 12:27:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 sending to next pipeline
2026-03-30 12:27:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31, identifier: NP50044
2026-03-30 12:27:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with identifier: NP50044
2026-03-30 12:27:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with identifier: NP50044
2026-03-30 12:27:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31 with identifier: NP50044 to the API
2026-03-30 12:27:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3604c717da927cbc550f85b198c2846d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:48:48Z',
'fuel_type': 'petrol',
'id': 'eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP50044',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 108268,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3604c717da927cbc550f85b198c2846d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_bfb169420aae323f963ebec7b33a808c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_4ed46354c4bf0855e6ff1b9423e46ff4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_a4931a5c216cf2560caad4b91325c792.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53443,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_d4caa1a3e66345b3e69e921515a0b946.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_e2c273dda8937df3aee1337398d8ca09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_2cb576a66fa424495304d2b28952d061.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_dd0855a48961226c6ef39b80af4fa27a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_36fc900116fddefb19e5d5e4689c0471.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31/eb2c0c8e-14b2-5b86-adc0-8f11c59cdd31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616a3de56da469e8c941e0220149424/pa/NP50044_3fa05a7a8c91e9e7455f874623fe980b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2016}
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP50044%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [auto1.it] INFO: Saving data for NP50044: {'created_time': 1774873622.271672, 'last_price_update_time': 1774873622.271683, 'auction_closing_time': 1774972128.0}
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP50044') HTTP/1.1" 204 0
2026-03-30 12:27:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU89254> (referer: https://www.auto1.com/v1/car-details-view/EU89254/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46aea36-50d2-57af-b39c-82e0550e8ba6 with identifier: EU89254
2026-03-30 12:27:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46aea36-50d2-57af-b39c-82e0550e8ba6 with scrape type 1
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c46aea36-50d2-57af-b39c-82e0550e8ba6
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_fd4770dce40dd23b23374aafaa6f2c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_fd4770dce40dd23b23374aafaa6f2c77.jpg already downloaded
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_f1ae19cf76e7697884244161c8dbf380.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_f1ae19cf76e7697884244161c8dbf380.jpg already downloaded
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_3d7aa5c8596ce207e5be96e019339323.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_3d7aa5c8596ce207e5be96e019339323.jpg already downloaded
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_e662c3ab56b1700a37f7cb788668e99b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_e662c3ab56b1700a37f7cb788668e99b.jpg already downloaded
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_58387ce9f4935101f6f810677c12489d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_58387ce9f4935101f6f810677c12489d.jpg already downloaded
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fc3%252F23c3d098b0bed03f1ac6a127c7971518%252Fpa%252FEU89254_7bcd9c5f822fb755842beb795d5bab9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_7bcd9c5f822fb755842beb795d5bab9c.jpg already downloaded
2026-03-30 12:27:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c46aea36-50d2-57af-b39c-82e0550e8ba6, identifier: EU89254
2026-03-30 12:27:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c46aea36-50d2-57af-b39c-82e0550e8ba6 with identifier: EU89254
2026-03-30 12:27:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c46aea36-50d2-57af-b39c-82e0550e8ba6 with identifier: EU89254
2026-03-30 12:27:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c46aea36-50d2-57af-b39c-82e0550e8ba6 with identifier: EU89254 to the API
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EU89254>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.3L',
'engine_horse_power': 83,
'expiration_date': '2026-03-31T15:58:17Z',
'fuel_type': 'petrol',
'id': 'c46aea36-50d2-57af-b39c-82e0550e8ba6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU89254',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Honda',
'model': 'Jazz',
'odometer': 153514,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_fd4770dce40dd23b23374aafaa6f2c77.jpg',
'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_f1ae19cf76e7697884244161c8dbf380.jpg',
'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_3d7aa5c8596ce207e5be96e019339323.jpg',
'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_e662c3ab56b1700a37f7cb788668e99b.jpg',
'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_58387ce9f4935101f6f810677c12489d.jpg',
'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_7bcd9c5f822fb755842beb795d5bab9c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_fd4770dce40dd23b23374aafaa6f2c77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_f1ae19cf76e7697884244161c8dbf380.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_3d7aa5c8596ce207e5be96e019339323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_e662c3ab56b1700a37f7cb788668e99b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_58387ce9f4935101f6f810677c12489d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46aea36-50d2-57af-b39c-82e0550e8ba6/c46aea36-50d2-57af-b39c-82e0550e8ba6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img23/c3/23c3d098b0bed03f1ac6a127c7971518/pa/EU89254_7bcd9c5f822fb755842beb795d5bab9c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.4 DSi Appeal',
'transmission': 'manual',
'trim': 'Appeal',
'year': 2006}
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU89254%27 HTTP/1.1" 200 None
2026-03-30 12:27:02 [auto1.it] INFO: Saving data for EU89254: {'created_time': 1774873622.993279, 'last_price_update_time': 1774873622.993291, 'auction_closing_time': 1774972697.0}
2026-03-30 12:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU89254') HTTP/1.1" 204 0
2026-03-30 12:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY76209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW52067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:04 [scrapy.extensions.logstats] INFO: Crawled 191 pages (at 14 pages/min), scraped 114 items (at 8 items/min)
2026-03-30 12:27:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:27:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR77304> (referer: https://www.auto1.com/v1/car-details-view/AR77304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with identifier: AR77304
2026-03-30 12:27:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with scrape type 1
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_080617ec3893a761230e97d73d27d104.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_080617ec3893a761230e97d73d27d104.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_79bdb34a34777bc144b044ba3d7879ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_79bdb34a34777bc144b044ba3d7879ab.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_514e6aff29a630febe50261eb85b4bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_514e6aff29a630febe50261eb85b4bff.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_eacf57534cfc2848cc669f67d9186751.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_eacf57534cfc2848cc669f67d9186751.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_8fda4fee19c18bc23b0e44e86b032650.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_8fda4fee19c18bc23b0e44e86b032650.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg not downloaded yet
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg not downloaded yet
2026-03-30 12:27:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV44549> (referer: https://www.auto1.com/v1/car-details-view/XV44549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a89813f5-f551-5996-8b7c-4d5bfbc2e57a with identifier: XV44549
2026-03-30 12:27:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a with scrape type 1
2026-03-30 12:27:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_774fd24583965a7629add8ca07a55943.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_774fd24583965a7629add8ca07a55943.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_a75f3a203491a854887c2b04e16a9e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_a75f3a203491a854887c2b04e16a9e60.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_9478218fc167fa26666101f3321fddd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_9478218fc167fa26666101f3321fddd8.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_1742ff2e6135f14e8bd982fb69184e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_1742ff2e6135f14e8bd982fb69184e94.jpg not downloaded yet
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_afea5c0da3403572988b6d86ccafe15a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_afea5c0da3403572988b6d86ccafe15a.jpg not downloaded yet
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg not downloaded yet
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601283bad0>
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg saved to cache
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_1742ff2e6135f14e8bd982fb69184e94.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e25410>
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_1742ff2e6135f14e8bd982fb69184e94.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_1742ff2e6135f14e8bd982fb69184e94.jpg saved to cache
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_afea5c0da3403572988b6d86ccafe15a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b00e90>
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg saved to cache
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3b310>
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_afea5c0da3403572988b6d86ccafe15a.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_afea5c0da3403572988b6d86ccafe15a.jpg saved to cache
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_9478218fc167fa26666101f3321fddd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3abd0>
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_9478218fc167fa26666101f3321fddd8.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_9478218fc167fa26666101f3321fddd8.jpg saved to cache
2026-03-30 12:27:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_a75f3a203491a854887c2b04e16a9e60.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010954150>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_a75f3a203491a854887c2b04e16a9e60.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_a75f3a203491a854887c2b04e16a9e60.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010957910>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3b150>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_774fd24583965a7629add8ca07a55943.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a94d90>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f3bd90>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_774fd24583965a7629add8ca07a55943.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_774fd24583965a7629add8ca07a55943.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fbaed0>
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F69%252F4a6963afa5e6e10a956cdb06755f58c5%252Fpa%252FXV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg saved to cache
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a
2026-03-30 12:27:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a89813f5-f551-5996-8b7c-4d5bfbc2e57a, skipping ID generation
2026-03-30 12:27:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a with scrape type 1
2026-03-30 12:27:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a89813f5-f551-5996-8b7c-4d5bfbc2e57a sending to next pipeline
2026-03-30 12:27:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a89813f5-f551-5996-8b7c-4d5bfbc2e57a, identifier: XV44549
2026-03-30 12:27:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a89813f5-f551-5996-8b7c-4d5bfbc2e57a with identifier: XV44549
2026-03-30 12:27:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a89813f5-f551-5996-8b7c-4d5bfbc2e57a with identifier: XV44549
2026-03-30 12:27:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a89813f5-f551-5996-8b7c-4d5bfbc2e57a with identifier: XV44549 to the API
2026-03-30 12:27:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:30:37Z',
'fuel_type': 'diesel',
'id': 'a89813f5-f551-5996-8b7c-4d5bfbc2e57a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV44549',
'listing': 'auction',
'location': 'IT, Latina',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 231355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_d7cd686b9e068fd0852ae3a6fabdbcf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_774fd24583965a7629add8ca07a55943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_459d1b9ec0c50fd7a6e6e6ee951ce9fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_fd413fbfcb664a19c493c61e7d1754ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_e2a45cc72239e5e89c4d711b54b18e98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_a75f3a203491a854887c2b04e16a9e60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_9478218fc167fa26666101f3321fddd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_1742ff2e6135f14e8bd982fb69184e94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_afea5c0da3403572988b6d86ccafe15a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89813f5-f551-5996-8b7c-4d5bfbc2e57a/a89813f5-f551-5996-8b7c-4d5bfbc2e57a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/69/4a6963afa5e6e10a956cdb06755f58c5/pa/XV44549_b450b78775dd5dfd6b2e261e4ce2836b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV44549%27 HTTP/1.1" 200 None
2026-03-30 12:27:10 [auto1.it] INFO: Saving data for XV44549: {'created_time': 1774873630.143224, 'last_price_update_time': 1774873630.143236, 'auction_closing_time': 1774971037.0}
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV44549') HTTP/1.1" 204 0
2026-03-30 12:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_8fda4fee19c18bc23b0e44e86b032650.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e24050>
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg saved to cache
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f72910>
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_8fda4fee19c18bc23b0e44e86b032650.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_8fda4fee19c18bc23b0e44e86b032650.jpg saved to cache
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3f110>
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg saved to cache
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_eacf57534cfc2848cc669f67d9186751.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f8f810>
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_eacf57534cfc2848cc669f67d9186751.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_eacf57534cfc2848cc669f67d9186751.jpg saved to cache
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010917550>
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg saved to cache
2026-03-30 12:27:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_514e6aff29a630febe50261eb85b4bff.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601091c610>
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_514e6aff29a630febe50261eb85b4bff.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_514e6aff29a630febe50261eb85b4bff.jpg saved to cache
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_79bdb34a34777bc144b044ba3d7879ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a62cd0>
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_79bdb34a34777bc144b044ba3d7879ab.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_79bdb34a34777bc144b044ba3d7879ab.jpg saved to cache
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_080617ec3893a761230e97d73d27d104.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601286be50>
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg saved to cache
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f71b50>
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Ff0%252Fb7f09ec31a15f4785b6ae078fd491532%252Fpa%252FAR77304_080617ec3893a761230e97d73d27d104.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_080617ec3893a761230e97d73d27d104.jpg saved to cache
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3
2026-03-30 12:27:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2aa91b7-cdb4-5243-8daf-20f1288aebc3, skipping ID generation
2026-03-30 12:27:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with scrape type 1
2026-03-30 12:27:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2aa91b7-cdb4-5243-8daf-20f1288aebc3 sending to next pipeline
2026-03-30 12:27:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2aa91b7-cdb4-5243-8daf-20f1288aebc3, identifier: AR77304
2026-03-30 12:27:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with identifier: AR77304
2026-03-30 12:27:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with identifier: AR77304
2026-03-30 12:27:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2aa91b7-cdb4-5243-8daf-20f1288aebc3 with identifier: AR77304 to the API
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_080617ec3893a761230e97d73d27d104.jpg>
{'auction_title': '',
'c_o_2_emission_value': 84,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:40:55Z',
'fuel_type': 'hybrid',
'id': 'b2aa91b7-cdb4-5243-8daf-20f1288aebc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR77304',
'listing': 'auction',
'location': 'IT, Palermo',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 83446,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_080617ec3893a761230e97d73d27d104.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_7e0b5945194a2ec9efbb23a6457e7e8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_79bdb34a34777bc144b044ba3d7879ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_514e6aff29a630febe50261eb85b4bff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_fd3709ab2e4d028c168fb63ec09a3abd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_eacf57534cfc2848cc669f67d9186751.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_04d3b15633dcd3a1c96a7e90f84898eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_8fda4fee19c18bc23b0e44e86b032650.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d3fd6b7bf5a61ec35fbed9ad23e1f6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2aa91b7-cdb4-5243-8daf-20f1288aebc3/b2aa91b7-cdb4-5243-8daf-20f1288aebc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/f0/b7f09ec31a15f4785b6ae078fd491532/pa/AR77304_6d8d7021ed5cefc5fffcecdaae444fbb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2018}
2026-03-30 12:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR77304%27 HTTP/1.1" 200 None
2026-03-30 12:27:12 [auto1.it] INFO: Saving data for AR77304: {'created_time': 1774873632.032841, 'last_price_update_time': 1774873632.032853, 'auction_closing_time': 1774971655.0}
2026-03-30 12:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR77304') HTTP/1.1" 204 0
2026-03-30 12:27:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB19627/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD19752> (referer: https://www.auto1.com/v1/car-details-view/PD19752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50 with identifier: PD19752
2026-03-30 12:27:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50 with scrape type 1
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_3b7300d158ae8232afcbe5729e1a2fa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_3b7300d158ae8232afcbe5729e1a2fa2.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_7439f9349f80d7ca9398ce4d0cf60c73.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_7439f9349f80d7ca9398ce4d0cf60c73.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_0adffd73ca8d64dbc55b6f47657e73ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_0adffd73ca8d64dbc55b6f47657e73ee.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_030380b5d52274fccd8fa8050dd44787.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_030380b5d52274fccd8fa8050dd44787.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_d610e6420dcca17447aae62d420ce2a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_d610e6420dcca17447aae62d420ce2a2.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_e73f375b62cdff869f5a3e36ebd36e14.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_e73f375b62cdff869f5a3e36ebd36e14.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_4566e9e1fafad205bd4a63cf95e1cff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_4566e9e1fafad205bd4a63cf95e1cff7.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_284172e9d8207734f2b98c000f098d48.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_284172e9d8207734f2b98c000f098d48.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_c732b4812e4634f343966bb28262b279.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_c732b4812e4634f343966bb28262b279.jpg already downloaded
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fad%252F83ad55c421f8e7210867b698b2070b4d%252Fpa%252FPD19752_a36369c049de00fb2d70c263998670a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_a36369c049de00fb2d70c263998670a0.jpg already downloaded
2026-03-30 12:27:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50, identifier: PD19752
2026-03-30 12:27:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50 with identifier: PD19752
2026-03-30 12:27:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50 with identifier: PD19752
2026-03-30 12:27:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50 with identifier: PD19752 to the API
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD19752>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 178,
'expiration_date': '2026-03-31T15:02:41Z',
'fuel_type': 'petrol',
'id': '2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD19752',
'listing': 'auction',
'location': 'IT',
'make': 'MINI',
'model': 'MINI',
'odometer': 39049,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_3b7300d158ae8232afcbe5729e1a2fa2.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_7439f9349f80d7ca9398ce4d0cf60c73.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_0adffd73ca8d64dbc55b6f47657e73ee.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_030380b5d52274fccd8fa8050dd44787.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_d610e6420dcca17447aae62d420ce2a2.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_e73f375b62cdff869f5a3e36ebd36e14.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_4566e9e1fafad205bd4a63cf95e1cff7.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_284172e9d8207734f2b98c000f098d48.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_c732b4812e4634f343966bb28262b279.jpg',
'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_a36369c049de00fb2d70c263998670a0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_3b7300d158ae8232afcbe5729e1a2fa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1988284,
'Height': 2448,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_7439f9349f80d7ca9398ce4d0cf60c73.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_0adffd73ca8d64dbc55b6f47657e73ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2369628,
'Height': 2448,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_030380b5d52274fccd8fa8050dd44787.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2169113,
'Height': 2448,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_d610e6420dcca17447aae62d420ce2a2.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2204295,
'Height': 2448,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_e73f375b62cdff869f5a3e36ebd36e14.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2168088,
'Height': 2448,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_4566e9e1fafad205bd4a63cf95e1cff7.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_284172e9d8207734f2b98c000f098d48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_c732b4812e4634f343966bb28262b279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50/2cc27825-5ccf-5f50-bc19-fb0ef2dbfa50_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ad/83ad55c421f8e7210867b698b2070b4d/pa/PD19752_a36369c049de00fb2d70c263998670a0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-17',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper S Essential Trim',
'transmission': 'automatic',
'trim': 'Essential Trim',
'year': 2022}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD19752%27 HTTP/1.1" 200 None
2026-03-30 12:27:18 [auto1.it] INFO: Saving data for PD19752: {'created_time': 1774873638.915525, 'last_price_update_time': 1774873638.915536, 'auction_closing_time': 1774969361.0}
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD19752') HTTP/1.1" 204 0
2026-03-30 12:27:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX56336> (referer: https://www.auto1.com/v1/car-details-view/PX56336/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bde1ca47-6f35-5792-ab40-d876920a3e32 with identifier: PX56336
2026-03-30 12:27:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bde1ca47-6f35-5792-ab40-d876920a3e32 with scrape type 1
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bde1ca47-6f35-5792-ab40-d876920a3e32
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_014ffb241a48199ea8bcea62413a86d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_014ffb241a48199ea8bcea62413a86d9.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_b5cc52f3fb10bb38533291bf842e2aef.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_b5cc52f3fb10bb38533291bf842e2aef.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_0fa93712078ad3c50884dfeea3293384.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_0fa93712078ad3c50884dfeea3293384.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_a4d1f1742869c193793e0ccb698af5c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_a4d1f1742869c193793e0ccb698af5c7.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_f4af1394b9d760dce33319c8698d60c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f4af1394b9d760dce33319c8698d60c2.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_ec69b3c87f7e290eb34879b501beec02.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_ec69b3c87f7e290eb34879b501beec02.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_d7e0c39892cfcc0071f1780408d8e4ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_d7e0c39892cfcc0071f1780408d8e4ce.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_c0998bd0220804aa2f1f28bbea2a6567.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_c0998bd0220804aa2f1f28bbea2a6567.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_f350ba9f7dde8083cd495186ba15d6ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f350ba9f7dde8083cd495186ba15d6ba.jpg already downloaded
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252Fb8%252Fd5b8da3cb68506a3a1d2421652de4f1c%252Fpa%252FPX56336_f0f8511d93716365c4ec97ea2406a4f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f0f8511d93716365c4ec97ea2406a4f5.jpg already downloaded
2026-03-30 12:27:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bde1ca47-6f35-5792-ab40-d876920a3e32, identifier: PX56336
2026-03-30 12:27:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bde1ca47-6f35-5792-ab40-d876920a3e32 with identifier: PX56336
2026-03-30 12:27:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bde1ca47-6f35-5792-ab40-d876920a3e32 with identifier: PX56336
2026-03-30 12:27:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bde1ca47-6f35-5792-ab40-d876920a3e32 with identifier: PX56336 to the API
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX56336>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:55:14Z',
'fuel_type': 'diesel',
'id': 'bde1ca47-6f35-5792-ab40-d876920a3e32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX56336',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 57618,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_014ffb241a48199ea8bcea62413a86d9.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_b5cc52f3fb10bb38533291bf842e2aef.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_0fa93712078ad3c50884dfeea3293384.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_a4d1f1742869c193793e0ccb698af5c7.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f4af1394b9d760dce33319c8698d60c2.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_ec69b3c87f7e290eb34879b501beec02.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_d7e0c39892cfcc0071f1780408d8e4ce.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_c0998bd0220804aa2f1f28bbea2a6567.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f350ba9f7dde8083cd495186ba15d6ba.jpg',
'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f0f8511d93716365c4ec97ea2406a4f5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_014ffb241a48199ea8bcea62413a86d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_b5cc52f3fb10bb38533291bf842e2aef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_0fa93712078ad3c50884dfeea3293384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_a4d1f1742869c193793e0ccb698af5c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f4af1394b9d760dce33319c8698d60c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_ec69b3c87f7e290eb34879b501beec02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_d7e0c39892cfcc0071f1780408d8e4ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_c0998bd0220804aa2f1f28bbea2a6567.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2583332,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f350ba9f7dde8083cd495186ba15d6ba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bde1ca47-6f35-5792-ab40-d876920a3e32/bde1ca47-6f35-5792-ab40-d876920a3e32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544804,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/b8/d5b8da3cb68506a3a1d2421652de4f1c/pa/PX56336_f0f8511d93716365c4ec97ea2406a4f5.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-16',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
'transmission': 'manual',
'trim': '300 L2 Trend',
'year': 2021}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX56336%27 HTTP/1.1" 200 None
2026-03-30 12:27:19 [auto1.it] INFO: Saving data for PX56336: {'created_time': 1774873639.773373, 'last_price_update_time': 1774873639.773385, 'auction_closing_time': 1774972514.0}
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX56336') HTTP/1.1" 204 0
2026-03-30 12:27:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV35786> (referer: https://www.auto1.com/v1/car-details-view/ZV35786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54054e27-2273-5817-b19c-f62a530a4e73 with identifier: ZV35786
2026-03-30 12:27:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54054e27-2273-5817-b19c-f62a530a4e73 with scrape type 1
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_303508da584c12801afd9c4c39a4573d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_303508da584c12801afd9c4c39a4573d.jpg not downloaded yet
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_75693600e4099f53e7c17329586df1fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_75693600e4099f53e7c17329586df1fc.jpg not downloaded yet
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg not downloaded yet
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_528a900d5b794d0ac299f2f110e20a85.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_528a900d5b794d0ac299f2f110e20a85.jpg not downloaded yet
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg not downloaded yet
2026-03-30 12:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE25949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff51d0>
2026-03-30 12:27:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg saved to cache
2026-03-30 12:27:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK95526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_528a900d5b794d0ac299f2f110e20a85.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6b210>
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_528a900d5b794d0ac299f2f110e20a85.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_528a900d5b794d0ac299f2f110e20a85.jpg saved to cache
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fccb90>
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg saved to cache
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX84486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_75693600e4099f53e7c17329586df1fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5f8d0>
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_75693600e4099f53e7c17329586df1fc.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_75693600e4099f53e7c17329586df1fc.jpg saved to cache
2026-03-30 12:27:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS62458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_303508da584c12801afd9c4c39a4573d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a85610>
2026-03-30 12:27:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe3%252F81e300a20d3b79aba8d91aebd673f319%252Fpa%252FZV35786_303508da584c12801afd9c4c39a4573d.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_303508da584c12801afd9c4c39a4573d.jpg saved to cache
2026-03-30 12:27:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54054e27-2273-5817-b19c-f62a530a4e73
2026-03-30 12:27:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54054e27-2273-5817-b19c-f62a530a4e73, skipping ID generation
2026-03-30 12:27:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54054e27-2273-5817-b19c-f62a530a4e73 with scrape type 1
2026-03-30 12:27:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54054e27-2273-5817-b19c-f62a530a4e73 sending to next pipeline
2026-03-30 12:27:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54054e27-2273-5817-b19c-f62a530a4e73, identifier: ZV35786
2026-03-30 12:27:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54054e27-2273-5817-b19c-f62a530a4e73 with identifier: ZV35786
2026-03-30 12:27:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54054e27-2273-5817-b19c-f62a530a4e73 with identifier: ZV35786
2026-03-30 12:27:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54054e27-2273-5817-b19c-f62a530a4e73 with identifier: ZV35786 to the API
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_303508da584c12801afd9c4c39a4573d.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'engine_horse_power': 103,
'expiration_date': '2026-03-31T15:49:09Z',
'fuel_type': 'petrol',
'id': '54054e27-2273-5817-b19c-f62a530a4e73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV35786',
'listing': 'auction',
'location': 'IT, Napoli',
'make': 'Fiat',
'model': 'Bravo',
'odometer': 117842,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_303508da584c12801afd9c4c39a4573d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_75693600e4099f53e7c17329586df1fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_7c98d04832bd5e92e2fd0323200b60bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_528a900d5b794d0ac299f2f110e20a85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54054e27-2273-5817-b19c-f62a530a4e73/54054e27-2273-5817-b19c-f62a530a4e73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/e3/81e300a20d3b79aba8d91aebd673f319/pa/ZV35786_097a2e51fe6d4e8dc87a33602b32a06f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1999-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Bravo 1.6 100 SX',
'transmission': 'manual',
'trim': '100 SX',
'year': 1999}
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV35786%27 HTTP/1.1" 200 None
2026-03-30 12:27:32 [auto1.it] INFO: Saving data for ZV35786: {'created_time': 1774873652.562061, 'last_price_update_time': 1774873652.562073, 'auction_closing_time': 1774972149.0}
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV35786') HTTP/1.1" 204 0
2026-03-30 12:27:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH99295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW52067> (referer: https://www.auto1.com/v1/car-details-view/DW52067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with identifier: DW52067
2026-03-30 12:27:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with scrape type 1
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_6501e1d5f8e52d10d32e6784d507c974.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_6501e1d5f8e52d10d32e6784d507c974.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_60407e3b108200c2575bc960fcafa0cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_60407e3b108200c2575bc960fcafa0cd.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_bfe478064b46493e5cef5528590eed8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_bfe478064b46493e5cef5528590eed8f.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_18389c4b7241fc6090069d9c08530745.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_18389c4b7241fc6090069d9c08530745.jpg not downloaded yet
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg not downloaded yet
2026-03-30 12:27:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK44685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010902550>
2026-03-30 12:27:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg saved to cache
2026-03-30 12:27:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN06178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_18389c4b7241fc6090069d9c08530745.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a855d0>
2026-03-30 12:27:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_18389c4b7241fc6090069d9c08530745.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_18389c4b7241fc6090069d9c08530745.jpg saved to cache
2026-03-30 12:27:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY76209> (referer: https://www.auto1.com/v1/car-details-view/XY76209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_bfe478064b46493e5cef5528590eed8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef250b64-6c45-58e9-80f4-c128963b6fbc with identifier: XY76209
2026-03-30 12:27:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef250b64-6c45-58e9-80f4-c128963b6fbc with scrape type 1
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_5ca4711027497d5efe82556c13812d4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5ca4711027497d5efe82556c13812d4f.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_3cfa69f3c9d69b4894641842cf30b065.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_3cfa69f3c9d69b4894641842cf30b065.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_45f79d0be535794223d22f89127c9b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_45f79d0be535794223d22f89127c9b1b.jpg not downloaded yet
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012868a50>
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_bfe478064b46493e5cef5528590eed8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_bfe478064b46493e5cef5528590eed8f.jpg saved to cache
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_75c4a106f9945db8b20fe7ac75963961.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_75c4a106f9945db8b20fe7ac75963961.jpg not downloaded yet
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_ba304041eb0b21579c261f950bc6e15e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_ba304041eb0b21579c261f950bc6e15e.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_dfef577753475c37163343c71e96341a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_dfef577753475c37163343c71e96341a.jpg not downloaded yet
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_04a90bbd451f8899cc70b75c7d503590.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_04a90bbd451f8899cc70b75c7d503590.jpg not downloaded yet
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a632d0>
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg saved to cache
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_45f79d0be535794223d22f89127c9b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_04a90bbd451f8899cc70b75c7d503590.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e045d0>
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_45f79d0be535794223d22f89127c9b1b.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_45f79d0be535794223d22f89127c9b1b.jpg saved to cache
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa4450>
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_04a90bbd451f8899cc70b75c7d503590.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_04a90bbd451f8899cc70b75c7d503590.jpg saved to cache
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_dfef577753475c37163343c71e96341a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108cac50>
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_dfef577753475c37163343c71e96341a.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_dfef577753475c37163343c71e96341a.jpg saved to cache
2026-03-30 12:27:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_ba304041eb0b21579c261f950bc6e15e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a352d0>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f61b50>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_ba304041eb0b21579c261f950bc6e15e.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_ba304041eb0b21579c261f950bc6e15e.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_75c4a106f9945db8b20fe7ac75963961.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aa4410>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_75c4a106f9945db8b20fe7ac75963961.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_75c4a106f9945db8b20fe7ac75963961.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_3cfa69f3c9d69b4894641842cf30b065.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a63a50>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_3cfa69f3c9d69b4894641842cf30b065.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_3cfa69f3c9d69b4894641842cf30b065.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010aae3d0>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5ca4711027497d5efe82556c13812d4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010957850>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e04610>
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F50%252F0c50cb860a5791b5d94434e19bd42e10%252Fpa%252FXY76209_5ca4711027497d5efe82556c13812d4f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5ca4711027497d5efe82556c13812d4f.jpg saved to cache
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef250b64-6c45-58e9-80f4-c128963b6fbc
2026-03-30 12:27:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef250b64-6c45-58e9-80f4-c128963b6fbc, skipping ID generation
2026-03-30 12:27:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef250b64-6c45-58e9-80f4-c128963b6fbc with scrape type 1
2026-03-30 12:27:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef250b64-6c45-58e9-80f4-c128963b6fbc sending to next pipeline
2026-03-30 12:27:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef250b64-6c45-58e9-80f4-c128963b6fbc, identifier: XY76209
2026-03-30 12:27:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef250b64-6c45-58e9-80f4-c128963b6fbc with identifier: XY76209
2026-03-30 12:27:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef250b64-6c45-58e9-80f4-c128963b6fbc with identifier: XY76209
2026-03-30 12:27:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef250b64-6c45-58e9-80f4-c128963b6fbc with identifier: XY76209 to the API
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5ca4711027497d5efe82556c13812d4f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:58:36Z',
'fuel_type': 'gas',
'id': 'ef250b64-6c45-58e9-80f4-c128963b6fbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY76209',
'listing': 'auction',
'location': 'IT, Salerno',
'make': 'DR',
'model': 'DR 6.0',
'odometer': 92105,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5ca4711027497d5efe82556c13812d4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_e8ab27d19dd5ad3ecc3a88474aa3cb94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_5f6a381b6b94c0925b0bf5d15e03d7da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_3cfa69f3c9d69b4894641842cf30b065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_45f79d0be535794223d22f89127c9b1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_75c4a106f9945db8b20fe7ac75963961.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_ba304041eb0b21579c261f950bc6e15e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_2f60cfbfbdbbaed7d0291599397642ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_dfef577753475c37163343c71e96341a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef250b64-6c45-58e9-80f4-c128963b6fbc/ef250b64-6c45-58e9-80f4-c128963b6fbc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/50/0c50cb860a5791b5d94434e19bd42e10/pa/XY76209_04a90bbd451f8899cc70b75c7d503590.jpg',
'Width': 776}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'DR DR 6.0 1.5 LPG',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY76209%27 HTTP/1.1" 200 None
2026-03-30 12:27:54 [auto1.it] INFO: Saving data for XY76209: {'created_time': 1774873674.345051, 'last_price_update_time': 1774873674.345065, 'auction_closing_time': 1774972716.0}
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XY76209') HTTP/1.1" 204 0
2026-03-30 12:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a96310>
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg saved to cache
2026-03-30 12:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a35b90>
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg saved to cache
2026-03-30 12:27:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_60407e3b108200c2575bc960fcafa0cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a25dd0>
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_60407e3b108200c2575bc960fcafa0cd.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_60407e3b108200c2575bc960fcafa0cd.jpg saved to cache
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a34b10>
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg saved to cache
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_6501e1d5f8e52d10d32e6784d507c974.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b01b50>
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_6501e1d5f8e52d10d32e6784d507c974.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_6501e1d5f8e52d10d32e6784d507c974.jpg saved to cache
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003eab9d0>
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F90%252Fe09021ff8722b5cccc13aea6f930c12f%252Fpa%252FDW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg saved to cache
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009
2026-03-30 12:27:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009, skipping ID generation
2026-03-30 12:27:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with scrape type 1
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 sending to next pipeline
2026-03-30 12:27:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009, identifier: DW52067
2026-03-30 12:27:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with identifier: DW52067
2026-03-30 12:27:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with identifier: DW52067
2026-03-30 12:27:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82951e7b-1fe7-5ef8-8c83-28b9f7c19009 with identifier: DW52067 to the API
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:57:16Z',
'fuel_type': 'petrol',
'id': '82951e7b-1fe7-5ef8-8c83-28b9f7c19009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW52067',
'listing': 'auction',
'location': 'IT, Lecco',
'make': 'Fiat',
'model': '500',
'odometer': 103485,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_fbdcb45f887dcaf2f788e82bf20df88e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_6501e1d5f8e52d10d32e6784d507c974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_d2878fa5d862b5a2fe8a5e7c651263ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_60407e3b108200c2575bc960fcafa0cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_4c0e34f4e1fbced28440e52f90ee93fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_cf5b103d968f1e9b1b4a435fad93a8d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_ea121f9e999983d4fa7eb108fafa9c16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_bfe478064b46493e5cef5528590eed8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_18389c4b7241fc6090069d9c08530745.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82951e7b-1fe7-5ef8-8c83-28b9f7c19009/82951e7b-1fe7-5ef8-8c83-28b9f7c19009_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/90/e09021ff8722b5cccc13aea6f930c12f/pa/DW52067_13b2bdadabfdf730f14ac79cd3cd051a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-09-07',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW52067%27 HTTP/1.1" 200 None
2026-03-30 12:27:55 [auto1.it] INFO: Saving data for DW52067: {'created_time': 1774873675.823787, 'last_price_update_time': 1774873675.823803, 'auction_closing_time': 1774972636.0}
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW52067') HTTP/1.1" 204 0
2026-03-30 12:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB19627> (referer: https://www.auto1.com/v1/car-details-view/ZB19627/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS76458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79c1daaa-93d4-5f96-a404-fead58b7bf4c with identifier: ZB19627
2026-03-30 12:27:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c1daaa-93d4-5f96-a404-fead58b7bf4c with scrape type 1
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 79c1daaa-93d4-5f96-a404-fead58b7bf4c
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F64%252Feb6495e33e0e9654cc7cb2a3dd39e3a2%252Fpa%252FZB19627_c6108a2a873e587262bd2dd2c7ff9f1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_c6108a2a873e587262bd2dd2c7ff9f1d.jpg already downloaded
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F64%252Feb6495e33e0e9654cc7cb2a3dd39e3a2%252Fpa%252FZB19627_9fcc400b68cf12076a9750006dc54b6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_9fcc400b68cf12076a9750006dc54b6a.jpg already downloaded
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F64%252Feb6495e33e0e9654cc7cb2a3dd39e3a2%252Fpa%252FZB19627_a1a7887f4a2505e88bafd67b07bcace5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_a1a7887f4a2505e88bafd67b07bcace5.jpg already downloaded
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F64%252Feb6495e33e0e9654cc7cb2a3dd39e3a2%252Fpa%252FZB19627_dbe10c5947aafd5d7e955b6476cf0873.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_dbe10c5947aafd5d7e955b6476cf0873.jpg already downloaded
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F64%252Feb6495e33e0e9654cc7cb2a3dd39e3a2%252Fpa%252FZB19627_3a9c936986087cb7d36f39ee0adba1e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_3a9c936986087cb7d36f39ee0adba1e2.jpg already downloaded
2026-03-30 12:27:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79c1daaa-93d4-5f96-a404-fead58b7bf4c, identifier: ZB19627
2026-03-30 12:27:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79c1daaa-93d4-5f96-a404-fead58b7bf4c with identifier: ZB19627
2026-03-30 12:27:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79c1daaa-93d4-5f96-a404-fead58b7bf4c with identifier: ZB19627
2026-03-30 12:27:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79c1daaa-93d4-5f96-a404-fead58b7bf4c with identifier: ZB19627 to the API
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:27:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB19627>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:47:45Z',
'fuel_type': 'petrol',
'id': '79c1daaa-93d4-5f96-a404-fead58b7bf4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB19627',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 136980,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_c6108a2a873e587262bd2dd2c7ff9f1d.jpg',
'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_9fcc400b68cf12076a9750006dc54b6a.jpg',
'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_a1a7887f4a2505e88bafd67b07bcace5.jpg',
'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_dbe10c5947aafd5d7e955b6476cf0873.jpg',
'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_3a9c936986087cb7d36f39ee0adba1e2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c1daaa-93d4-5f96-a404-fead58b7bf4c/79c1daaa-93d4-5f96-a404-fead58b7bf4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_c6108a2a873e587262bd2dd2c7ff9f1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c1daaa-93d4-5f96-a404-fead58b7bf4c/79c1daaa-93d4-5f96-a404-fead58b7bf4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_9fcc400b68cf12076a9750006dc54b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c1daaa-93d4-5f96-a404-fead58b7bf4c/79c1daaa-93d4-5f96-a404-fead58b7bf4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59686,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_a1a7887f4a2505e88bafd67b07bcace5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c1daaa-93d4-5f96-a404-fead58b7bf4c/79c1daaa-93d4-5f96-a404-fead58b7bf4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_dbe10c5947aafd5d7e955b6476cf0873.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c1daaa-93d4-5f96-a404-fead58b7bf4c/79c1daaa-93d4-5f96-a404-fead58b7bf4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/64/eb6495e33e0e9654cc7cb2a3dd39e3a2/pa/ZB19627_3a9c936986087cb7d36f39ee0adba1e2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-11-05',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2006}
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB19627%27 HTTP/1.1" 200 None
2026-03-30 12:27:56 [auto1.it] INFO: Saving data for ZB19627: {'created_time': 1774873676.414554, 'last_price_update_time': 1774873676.414568, 'auction_closing_time': 1774972065.0}
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZB19627') HTTP/1.1" 204 0
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK95526> (referer: https://www.auto1.com/v1/car-details-view/EK95526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8296d5a-788f-52fe-a64f-e89e23be907b with identifier: EK95526
2026-03-30 12:27:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8296d5a-788f-52fe-a64f-e89e23be907b with scrape type 1
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_4861d9debef15097301866d8fc63ef96.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_4861d9debef15097301866d8fc63ef96.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_6660b4cf512010ba74177efb755447b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6660b4cf512010ba74177efb755447b0.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_dee750070af0f044bd4102a4388e0dbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_dee750070af0f044bd4102a4388e0dbb.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_09d4f2470e7e43f163d319502de933ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_09d4f2470e7e43f163d319502de933ce.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_1654e567398701d424ef34c8c19fffa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1654e567398701d424ef34c8c19fffa6.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg not downloaded yet
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_4861d9debef15097301866d8fc63ef96.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg not downloaded yet
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg not downloaded yet
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f9b7d0>
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_4861d9debef15097301866d8fc63ef96.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_4861d9debef15097301866d8fc63ef96.jpg saved to cache
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6660b4cf512010ba74177efb755447b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1654e567398701d424ef34c8c19fffa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX84486> (referer: https://www.auto1.com/v1/car-details-view/MX84486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:27:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012aed610>
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg saved to cache
2026-03-30 12:27:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108cb590>
2026-03-30 12:27:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_6660b4cf512010ba74177efb755447b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6660b4cf512010ba74177efb755447b0.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fda090>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_1654e567398701d424ef34c8c19fffa6.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1654e567398701d424ef34c8c19fffa6.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with identifier: MX84486
2026-03-30 12:27:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with scrape type 1
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg not downloaded yet
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg not downloaded yet
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_1b975a2937024479e64a4b59752abf7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_1b975a2937024479e64a4b59752abf7c.jpg not downloaded yet
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg not downloaded yet
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_6a878db44d8f34bfbae77730825e098e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_6a878db44d8f34bfbae77730825e098e.jpg not downloaded yet
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg not downloaded yet
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg not downloaded yet
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg not downloaded yet
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010937890>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e7c090>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e55550>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_c8a86489b6169b52f6de63af3949b7b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_c8a86489b6169b52f6de63af3949b7b5.jpg not downloaded yet
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_dee750070af0f044bd4102a4388e0dbb.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_09d4f2470e7e43f163d319502de933ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_bba90877536a0293d3c1567a4841e9f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_bba90877536a0293d3c1567a4841e9f7.jpg not downloaded yet
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e7d010>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:27:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e50190>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a416d0>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_dee750070af0f044bd4102a4388e0dbb.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_dee750070af0f044bd4102a4388e0dbb.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f55390>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108ca6d0>
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:27:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F85%252Fb4852a76302871939db9bab7f05261b2%252Fpa%252FEK95526_09d4f2470e7e43f163d319502de933ce.jpg') HTTP/1.1" 204 0
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_09d4f2470e7e43f163d319502de933ce.jpg saved to cache
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8296d5a-788f-52fe-a64f-e89e23be907b
2026-03-30 12:27:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8296d5a-788f-52fe-a64f-e89e23be907b, skipping ID generation
2026-03-30 12:27:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8296d5a-788f-52fe-a64f-e89e23be907b with scrape type 1
2026-03-30 12:27:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8296d5a-788f-52fe-a64f-e89e23be907b sending to next pipeline
2026-03-30 12:27:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8296d5a-788f-52fe-a64f-e89e23be907b, identifier: EK95526
2026-03-30 12:27:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8296d5a-788f-52fe-a64f-e89e23be907b with identifier: EK95526
2026-03-30 12:27:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8296d5a-788f-52fe-a64f-e89e23be907b with identifier: EK95526
2026-03-30 12:27:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8296d5a-788f-52fe-a64f-e89e23be907b with identifier: EK95526 to the API
2026-03-30 12:27:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:27:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_09d4f2470e7e43f163d319502de933ce.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:09:50Z',
'fuel_type': 'petrol',
'id': 'd8296d5a-788f-52fe-a64f-e89e23be907b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK95526',
'listing': 'auction',
'location': 'IT, Pompei',
'make': 'Smart',
'model': 'fortwo',
'odometer': 118438,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_4861d9debef15097301866d8fc63ef96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_2e0891bb99bd90d310b78cb7fa47fc2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6660b4cf512010ba74177efb755447b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_dee750070af0f044bd4102a4388e0dbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_09d4f2470e7e43f163d319502de933ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1654e567398701d424ef34c8c19fffa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_1a1937415bbe1858eeecd8ca1a32922f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_6fddcaa574c2ba911ca50d8654a9a2b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_b11dfe0f7f7022805c385f7f6df5d8d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8296d5a-788f-52fe-a64f-e89e23be907b/d8296d5a-788f-52fe-a64f-e89e23be907b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/85/b4852a76302871939db9bab7f05261b2/pa/EK95526_eff7c2d6d8e6a029e69ead8c5ecadf8f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-07-30',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pure',
'year': 2013}
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK95526%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.it] INFO: Saving data for EK95526: {'created_time': 1774873680.06746, 'last_price_update_time': 1774873680.067476, 'auction_closing_time': 1774969790.0}
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK95526') HTTP/1.1" 204 0
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_bba90877536a0293d3c1567a4841e9f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_c8a86489b6169b52f6de63af3949b7b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE25949> (referer: https://www.auto1.com/v1/car-details-view/LE25949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f48d10>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg saved to cache
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fd4fd0>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg saved to cache
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_1b975a2937024479e64a4b59752abf7c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f66790>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_bba90877536a0293d3c1567a4841e9f7.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_bba90877536a0293d3c1567a4841e9f7.jpg saved to cache
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f84c50>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg saved to cache
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010935290>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_c8a86489b6169b52f6de63af3949b7b5.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_c8a86489b6169b52f6de63af3949b7b5.jpg saved to cache
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1be910-53ab-5034-b65f-e6b613d4a0c7 with identifier: LE25949
2026-03-30 12:28:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1be910-53ab-5034-b65f-e6b613d4a0c7 with scrape type 1
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d1be910-53ab-5034-b65f-e6b613d4a0c7
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_3c70c7791c32e84b43dc301c37672c4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_3c70c7791c32e84b43dc301c37672c4d.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_679a73901c0da7e92fab239db12dc00d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_679a73901c0da7e92fab239db12dc00d.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_f7a54546d2209f4a8a77bf7ef15e2428.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_f7a54546d2209f4a8a77bf7ef15e2428.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_ec4e0a8e1c549e4a464b1310d143f3f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ec4e0a8e1c549e4a464b1310d143f3f7.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_9362ffd7bf2ed99f564b2f7f2c965402.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_9362ffd7bf2ed99f564b2f7f2c965402.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_5a62cb3799e1952874f6da65b655036c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_5a62cb3799e1952874f6da65b655036c.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_b5bf0c2a077b15461b0256de411a1c91.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_b5bf0c2a077b15461b0256de411a1c91.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_6b554222e68db0ce28e0c499c0a5ae4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_6b554222e68db0ce28e0c499c0a5ae4f.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_ab168920a843bea2801ea7af41bb0b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ab168920a843bea2801ea7af41bb0b9e.jpg already downloaded
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F16%252F6916c7454072d4f7b23cb81405944f31%252Fpa%252FLE25949_80778f6c89c31d170097ab0197f1d6d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_80778f6c89c31d170097ab0197f1d6d6.jpg already downloaded
2026-03-30 12:28:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d1be910-53ab-5034-b65f-e6b613d4a0c7, identifier: LE25949
2026-03-30 12:28:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d1be910-53ab-5034-b65f-e6b613d4a0c7 with identifier: LE25949
2026-03-30 12:28:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d1be910-53ab-5034-b65f-e6b613d4a0c7 with identifier: LE25949
2026-03-30 12:28:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d1be910-53ab-5034-b65f-e6b613d4a0c7 with identifier: LE25949 to the API
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE25949>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:34:02Z',
'fuel_type': 'diesel',
'id': '2d1be910-53ab-5034-b65f-e6b613d4a0c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE25949',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Fiat',
'model': '500L',
'odometer': 166100,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_3c70c7791c32e84b43dc301c37672c4d.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_679a73901c0da7e92fab239db12dc00d.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_f7a54546d2209f4a8a77bf7ef15e2428.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ec4e0a8e1c549e4a464b1310d143f3f7.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_9362ffd7bf2ed99f564b2f7f2c965402.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_5a62cb3799e1952874f6da65b655036c.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_b5bf0c2a077b15461b0256de411a1c91.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_6b554222e68db0ce28e0c499c0a5ae4f.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ab168920a843bea2801ea7af41bb0b9e.jpg',
'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_80778f6c89c31d170097ab0197f1d6d6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_3c70c7791c32e84b43dc301c37672c4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_679a73901c0da7e92fab239db12dc00d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_f7a54546d2209f4a8a77bf7ef15e2428.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ec4e0a8e1c549e4a464b1310d143f3f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_9362ffd7bf2ed99f564b2f7f2c965402.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_5a62cb3799e1952874f6da65b655036c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_b5bf0c2a077b15461b0256de411a1c91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_6b554222e68db0ce28e0c499c0a5ae4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_ab168920a843bea2801ea7af41bb0b9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1be910-53ab-5034-b65f-e6b613d4a0c7/2d1be910-53ab-5034-b65f-e6b613d4a0c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img69/16/6916c7454072d4f7b23cb81405944f31/pa/LE25949_80778f6c89c31d170097ab0197f1d6d6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Cross',
'transmission': 'manual',
'trim': 'Cross',
'year': 2017}
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE25949%27 HTTP/1.1" 200 None
2026-03-30 12:28:00 [auto1.it] INFO: Saving data for LE25949: {'created_time': 1774873680.939611, 'last_price_update_time': 1774873680.939622, 'auction_closing_time': 1774971242.0}
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LE25949') HTTP/1.1" 204 0
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_6a878db44d8f34bfbae77730825e098e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60108da210>
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_1b975a2937024479e64a4b59752abf7c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_1b975a2937024479e64a4b59752abf7c.jpg saved to cache
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f4d390>
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_6a878db44d8f34bfbae77730825e098e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_6a878db44d8f34bfbae77730825e098e.jpg saved to cache
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f601172e390>
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F57%252F3757228f618b85bed988756e5c8a0a3c%252Fpa%252FMX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg saved to cache
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b
2026-03-30 12:28:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b, skipping ID generation
2026-03-30 12:28:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with scrape type 1
2026-03-30 12:28:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b sending to next pipeline
2026-03-30 12:28:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b, identifier: MX84486
2026-03-30 12:28:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with identifier: MX84486
2026-03-30 12:28:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with identifier: MX84486
2026-03-30 12:28:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d448b6b-06a2-5c9b-82c9-b378a9fdf89b with identifier: MX84486 to the API
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:38:42Z',
'fuel_type': 'diesel',
'id': '4d448b6b-06a2-5c9b-82c9-b378a9fdf89b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX84486',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 19058,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cb478e2d7951b6998b2d9af6ab102fa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_3752a79ab41e9d1aa82617a8ee3a20b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_1b975a2937024479e64a4b59752abf7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_ad753f8459c789169f6b27e7eb4dcb23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_6a878db44d8f34bfbae77730825e098e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_4e0ab87ab81734b9ab8515e04fa71a8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cf3a9b9ddb0ee10fff8c052505a36f7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_cc4ac6d73ea049399e66e4e00612a0ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_c8a86489b6169b52f6de63af3949b7b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d448b6b-06a2-5c9b-82c9-b378a9fdf89b/4d448b6b-06a2-5c9b-82c9-b378a9fdf89b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/57/3757228f618b85bed988756e5c8a0a3c/pa/MX84486_bba90877536a0293d3c1567a4841e9f7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2025-05-18',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Max',
'transmission': 'automatic',
'trim': 'Max',
'year': 2025}
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX84486%27 HTTP/1.1" 200 None
2026-03-30 12:28:01 [auto1.it] INFO: Saving data for MX84486: {'created_time': 1774873681.625004, 'last_price_update_time': 1774873681.625015, 'auction_closing_time': 1774971522.0}
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX84486') HTTP/1.1" 204 0
2026-03-30 12:28:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP07384/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:04 [scrapy.extensions.logstats] INFO: Crawled 212 pages (at 21 pages/min), scraped 125 items (at 11 items/min)
2026-03-30 12:28:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS62458> (referer: https://www.auto1.com/v1/car-details-view/LS62458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03165f9c-f96e-538a-89e3-8cc976cde79b with identifier: LS62458
2026-03-30 12:28:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03165f9c-f96e-538a-89e3-8cc976cde79b with scrape type 1
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_fa1f8f53427503afb8584440447243a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fa1f8f53427503afb8584440447243a1.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_14890d06d0d4126aac0b06540742bb97.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_14890d06d0d4126aac0b06540742bb97.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_2ecaa853592b2593969714ceaae58d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2ecaa853592b2593969714ceaae58d10.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_2293c560add8bc9cb985552663329955.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2293c560add8bc9cb985552663329955.jpg not downloaded yet
2026-03-30 12:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fa1f8f53427503afb8584440447243a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg not downloaded yet
2026-03-30 12:28:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_a217b11532180366f146ab6ec1fef416.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_a217b11532180366f146ab6ec1fef416.jpg not downloaded yet
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_6f31eb5fa198b9edca434d536b331a6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_6f31eb5fa198b9edca434d536b331a6d.jpg not downloaded yet
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_29823bcb07bc90f0292092816ba783bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_29823bcb07bc90f0292092816ba783bd.jpg not downloaded yet
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2293c560add8bc9cb985552663329955.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a41a90>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_fa1f8f53427503afb8584440447243a1.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fa1f8f53427503afb8584440447243a1.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_14890d06d0d4126aac0b06540742bb97.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_6f31eb5fa198b9edca434d536b331a6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a3bed0>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f4a010>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_2293c560add8bc9cb985552663329955.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2293c560add8bc9cb985552663329955.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e04a10>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_14890d06d0d4126aac0b06540742bb97.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_14890d06d0d4126aac0b06540742bb97.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2ecaa853592b2593969714ceaae58d10.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ea9050>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_6f31eb5fa198b9edca434d536b331a6d.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_6f31eb5fa198b9edca434d536b331a6d.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fef290>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_a217b11532180366f146ab6ec1fef416.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_29823bcb07bc90f0292092816ba783bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e3e810>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK44685> (referer: https://www.auto1.com/v1/car-details-view/YK44685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e2cad0>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_2ecaa853592b2593969714ceaae58d10.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2ecaa853592b2593969714ceaae58d10.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b01790>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_a217b11532180366f146ab6ec1fef416.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_a217b11532180366f146ab6ec1fef416.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f6e350>
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F36%252Fd6367dc444eebe495f5e86afd90c38eb%252Fpa%252FLS62458_29823bcb07bc90f0292092816ba783bd.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_29823bcb07bc90f0292092816ba783bd.jpg saved to cache
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03165f9c-f96e-538a-89e3-8cc976cde79b
2026-03-30 12:28:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03165f9c-f96e-538a-89e3-8cc976cde79b, skipping ID generation
2026-03-30 12:28:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03165f9c-f96e-538a-89e3-8cc976cde79b with scrape type 1
2026-03-30 12:28:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03165f9c-f96e-538a-89e3-8cc976cde79b sending to next pipeline
2026-03-30 12:28:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03165f9c-f96e-538a-89e3-8cc976cde79b, identifier: LS62458
2026-03-30 12:28:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03165f9c-f96e-538a-89e3-8cc976cde79b with identifier: LS62458
2026-03-30 12:28:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03165f9c-f96e-538a-89e3-8cc976cde79b with identifier: LS62458
2026-03-30 12:28:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03165f9c-f96e-538a-89e3-8cc976cde79b with identifier: LS62458 to the API
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_29823bcb07bc90f0292092816ba783bd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:27:23Z',
'fuel_type': 'diesel',
'id': '03165f9c-f96e-538a-89e3-8cc976cde79b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS62458',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Renault',
'model': 'Megane',
'odometer': 255556,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_c6aa21919dbc976cd82aa623cc53fdd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fa1f8f53427503afb8584440447243a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_b029ae85f4d4be66be6b92f50f4abf06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_14890d06d0d4126aac0b06540742bb97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2ecaa853592b2593969714ceaae58d10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_2293c560add8bc9cb985552663329955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_fdbfef16b1f7146fb92da46d0da0aff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_a217b11532180366f146ab6ec1fef416.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_6f31eb5fa198b9edca434d536b331a6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03165f9c-f96e-538a-89e3-8cc976cde79b/03165f9c-f96e-538a-89e3-8cc976cde79b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/36/d6367dc444eebe495f5e86afd90c38eb/pa/LS62458_29823bcb07bc90f0292092816ba783bd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS62458%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [auto1.it] INFO: Saving data for LS62458: {'created_time': 1774873691.094205, 'last_price_update_time': 1774873691.094215, 'auction_closing_time': 1774970843.0}
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS62458') HTTP/1.1" 204 0
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY93088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c12f9b0-0b66-55a8-b342-2809393a4f24 with identifier: YK44685
2026-03-30 12:28:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c12f9b0-0b66-55a8-b342-2809393a4f24 with scrape type 1
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_145b6ce964d65d30e5aa4985946cca7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_145b6ce964d65d30e5aa4985946cca7e.jpg not downloaded yet
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg not downloaded yet
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg not downloaded yet
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_622d6ee240ef45d374a5c8833c357446.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_622d6ee240ef45d374a5c8833c357446.jpg not downloaded yet
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_45e7904689bed604581e0fff0e6ee9fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_45e7904689bed604581e0fff0e6ee9fe.jpg not downloaded yet
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg not downloaded yet
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_145b6ce964d65d30e5aa4985946cca7e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_622d6ee240ef45d374a5c8833c357446.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_45e7904689bed604581e0fff0e6ee9fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003e108d0>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_145b6ce964d65d30e5aa4985946cca7e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_145b6ce964d65d30e5aa4985946cca7e.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fc4d50>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_622d6ee240ef45d374a5c8833c357446.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_622d6ee240ef45d374a5c8833c357446.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f5cad0>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_45e7904689bed604581e0fff0e6ee9fe.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_45e7904689bed604581e0fff0e6ee9fe.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b01a50>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fdf010>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003faac10>
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F31%252F9f31813d1a34e71ffac235ac26224f78%252Fpa%252FYK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg saved to cache
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c12f9b0-0b66-55a8-b342-2809393a4f24
2026-03-30 12:28:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c12f9b0-0b66-55a8-b342-2809393a4f24, skipping ID generation
2026-03-30 12:28:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c12f9b0-0b66-55a8-b342-2809393a4f24 with scrape type 1
2026-03-30 12:28:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c12f9b0-0b66-55a8-b342-2809393a4f24 sending to next pipeline
2026-03-30 12:28:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c12f9b0-0b66-55a8-b342-2809393a4f24, identifier: YK44685
2026-03-30 12:28:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c12f9b0-0b66-55a8-b342-2809393a4f24 with identifier: YK44685
2026-03-30 12:28:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c12f9b0-0b66-55a8-b342-2809393a4f24 with identifier: YK44685
2026-03-30 12:28:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c12f9b0-0b66-55a8-b342-2809393a4f24 with identifier: YK44685 to the API
2026-03-30 12:28:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:42:41Z',
'fuel_type': 'petrol',
'id': '0c12f9b0-0b66-55a8-b342-2809393a4f24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK44685',
'listing': 'auction',
'location': 'IT, Bologna',
'make': 'Fiat',
'model': '500',
'odometer': 203377,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_145b6ce964d65d30e5aa4985946cca7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_345fa1ce0f8cebcb6a94a78838e87244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_c2a2eeef37dee519e81e14fb7b4362cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_622d6ee240ef45d374a5c8833c357446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_45e7904689bed604581e0fff0e6ee9fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c12f9b0-0b66-55a8-b342-2809393a4f24/0c12f9b0-0b66-55a8-b342-2809393a4f24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/31/9f31813d1a34e71ffac235ac26224f78/pa/YK44685_7c2536e596f6b76ae62cd3f36db27e11.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-03-30',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2010}
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK44685%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [auto1.it] INFO: Saving data for YK44685: {'created_time': 1774873692.150693, 'last_price_update_time': 1774873692.150702, 'auction_closing_time': 1774971761.0}
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK44685') HTTP/1.1" 204 0
2026-03-30 12:28:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS76458> (referer: https://www.auto1.com/v1/car-details-view/LS76458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2940636-abeb-5d83-943d-0776bd16af06 with identifier: LS76458
2026-03-30 12:28:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2940636-abeb-5d83-943d-0776bd16af06 with scrape type 1
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2940636-abeb-5d83-943d-0776bd16af06
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_29b8fea9c76813eb5b44785d355e79b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_29b8fea9c76813eb5b44785d355e79b3.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_e616dd8fc9384b43251c13543814a22c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_e616dd8fc9384b43251c13543814a22c.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_becb91b3a769edbb0854b78a2c16657a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_becb91b3a769edbb0854b78a2c16657a.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_fb207ec7b698f8f9b750d3e11f938df6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_fb207ec7b698f8f9b750d3e11f938df6.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_c5bc3f7aed277d6cfa026cabff269648.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_c5bc3f7aed277d6cfa026cabff269648.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_9421a1e227f52e7b0d702b58c2554256.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_9421a1e227f52e7b0d702b58c2554256.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_bf3d2ffab2c22e73c50fdc9cfc4e65e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_bf3d2ffab2c22e73c50fdc9cfc4e65e3.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_6134eef8fa6fa081d0e477ba4955d7c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_6134eef8fa6fa081d0e477ba4955d7c7.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_55a95ca81039c85ea5b05e3321d15baa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_55a95ca81039c85ea5b05e3321d15baa.jpg already downloaded
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7e%252Fe37eac8846e5b15fee10011da79bd84e%252Fpa%252FLS76458_1eb1b56df10ca6b06e001d050de81057.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_1eb1b56df10ca6b06e001d050de81057.jpg already downloaded
2026-03-30 12:28:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2940636-abeb-5d83-943d-0776bd16af06, identifier: LS76458
2026-03-30 12:28:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2940636-abeb-5d83-943d-0776bd16af06 with identifier: LS76458
2026-03-30 12:28:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2940636-abeb-5d83-943d-0776bd16af06 with identifier: LS76458
2026-03-30 12:28:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2940636-abeb-5d83-943d-0776bd16af06 with identifier: LS76458 to the API
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LS76458>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:07:35Z',
'fuel_type': 'diesel',
'id': 'b2940636-abeb-5d83-943d-0776bd16af06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS76458',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'BMW',
'model': '3er',
'odometer': 223922,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_29b8fea9c76813eb5b44785d355e79b3.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_e616dd8fc9384b43251c13543814a22c.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_becb91b3a769edbb0854b78a2c16657a.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_fb207ec7b698f8f9b750d3e11f938df6.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_c5bc3f7aed277d6cfa026cabff269648.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_9421a1e227f52e7b0d702b58c2554256.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_bf3d2ffab2c22e73c50fdc9cfc4e65e3.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_6134eef8fa6fa081d0e477ba4955d7c7.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_55a95ca81039c85ea5b05e3321d15baa.jpg',
'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_1eb1b56df10ca6b06e001d050de81057.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_29b8fea9c76813eb5b44785d355e79b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_e616dd8fc9384b43251c13543814a22c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_becb91b3a769edbb0854b78a2c16657a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_fb207ec7b698f8f9b750d3e11f938df6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_c5bc3f7aed277d6cfa026cabff269648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_9421a1e227f52e7b0d702b58c2554256.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2719448,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_bf3d2ffab2c22e73c50fdc9cfc4e65e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_6134eef8fa6fa081d0e477ba4955d7c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_55a95ca81039c85ea5b05e3321d15baa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2940636-abeb-5d83-943d-0776bd16af06/b2940636-abeb-5d83-943d-0776bd16af06_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170316,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge3/7e/e37eac8846e5b15fee10011da79bd84e/pa/LS76458_1eb1b56df10ca6b06e001d050de81057.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-02-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 316d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS76458%27 HTTP/1.1" 200 None
2026-03-30 12:28:12 [auto1.it] INFO: Saving data for LS76458: {'created_time': 1774873692.960325, 'last_price_update_time': 1774873692.960335, 'auction_closing_time': 1774969655.0}
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS76458') HTTP/1.1" 204 0
2026-03-30 12:28:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.447(s), this was the 1st time calling it.
2026-03-30 12:28:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.935082487579026 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN06178> (referer: https://www.auto1.com/v1/car-details-view/XN06178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e983b2d-9489-5613-bbb2-eea977a710f4 with identifier: XN06178
2026-03-30 12:28:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e983b2d-9489-5613-bbb2-eea977a710f4 with scrape type 1
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5e983b2d-9489-5613-bbb2-eea977a710f4
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F0b%252Ffc0b86f14d90914f7afc3aeb624612bc%252Fpa%252FXN06178_0f67b19ef73fc7d2c67b6925bd80e1e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_0f67b19ef73fc7d2c67b6925bd80e1e5.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F0b%252Ffc0b86f14d90914f7afc3aeb624612bc%252Fpa%252FXN06178_8059a13c4ed9404615fbeee223aac1af.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_8059a13c4ed9404615fbeee223aac1af.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F0b%252Ffc0b86f14d90914f7afc3aeb624612bc%252Fpa%252FXN06178_c816990c469233ca70548b44a0b3657e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_c816990c469233ca70548b44a0b3657e.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F0b%252Ffc0b86f14d90914f7afc3aeb624612bc%252Fpa%252FXN06178_fe5bcfa8279808ba29231bfa8231b6c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_fe5bcfa8279808ba29231bfa8231b6c0.jpg already downloaded
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F0b%252Ffc0b86f14d90914f7afc3aeb624612bc%252Fpa%252FXN06178_9e59c65e672faaa8de6575e201333153.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_9e59c65e672faaa8de6575e201333153.jpg already downloaded
2026-03-30 12:28:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e983b2d-9489-5613-bbb2-eea977a710f4, identifier: XN06178
2026-03-30 12:28:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e983b2d-9489-5613-bbb2-eea977a710f4 with identifier: XN06178
2026-03-30 12:28:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e983b2d-9489-5613-bbb2-eea977a710f4 with identifier: XN06178
2026-03-30 12:28:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e983b2d-9489-5613-bbb2-eea977a710f4 with identifier: XN06178 to the API
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XN06178>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:53:25Z',
'fuel_type': 'hybrid',
'id': '5e983b2d-9489-5613-bbb2-eea977a710f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN06178',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Toyota',
'model': 'Prius',
'odometer': 172624,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_0f67b19ef73fc7d2c67b6925bd80e1e5.jpg',
'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_8059a13c4ed9404615fbeee223aac1af.jpg',
'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_c816990c469233ca70548b44a0b3657e.jpg',
'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_fe5bcfa8279808ba29231bfa8231b6c0.jpg',
'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_9e59c65e672faaa8de6575e201333153.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e983b2d-9489-5613-bbb2-eea977a710f4/5e983b2d-9489-5613-bbb2-eea977a710f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_0f67b19ef73fc7d2c67b6925bd80e1e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e983b2d-9489-5613-bbb2-eea977a710f4/5e983b2d-9489-5613-bbb2-eea977a710f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_8059a13c4ed9404615fbeee223aac1af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e983b2d-9489-5613-bbb2-eea977a710f4/5e983b2d-9489-5613-bbb2-eea977a710f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_c816990c469233ca70548b44a0b3657e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e983b2d-9489-5613-bbb2-eea977a710f4/5e983b2d-9489-5613-bbb2-eea977a710f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_fe5bcfa8279808ba29231bfa8231b6c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e983b2d-9489-5613-bbb2-eea977a710f4/5e983b2d-9489-5613-bbb2-eea977a710f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/0b/fc0b86f14d90914f7afc3aeb624612bc/pa/XN06178_9e59c65e672faaa8de6575e201333153.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-10-07',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Prius 1.5 Sol',
'transmission': 'automatic',
'trim': 'Sol',
'year': 2008}
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN06178%27 HTTP/1.1" 200 None
2026-03-30 12:28:18 [auto1.it] INFO: Saving data for XN06178: {'created_time': 1774873698.581485, 'last_price_update_time': 1774873698.581498, 'auction_closing_time': 1774972405.0}
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN06178') HTTP/1.1" 204 0
2026-03-30 12:28:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.304(s), this was the 1st time calling it.
2026-03-30 12:28:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.015482174151238 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:28:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH99295> (referer: https://www.auto1.com/v1/car-details-view/WH99295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a998313-31fc-5f67-8844-419231905d98 with identifier: WH99295
2026-03-30 12:28:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a998313-31fc-5f67-8844-419231905d98 with scrape type 1
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a998313-31fc-5f67-8844-419231905d98
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_2eafd5b280753d4e82ab223c932f8ef9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_2eafd5b280753d4e82ab223c932f8ef9.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_69ba9a8bdff3a8df34957e113b26760b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_69ba9a8bdff3a8df34957e113b26760b.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_567458a9916fa25aa457fdbecd98a8a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_567458a9916fa25aa457fdbecd98a8a6.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_c36412f465cb10d36b20e50e864d92be.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_c36412f465cb10d36b20e50e864d92be.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_622225dfbc6759035dc24141fc402131.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_622225dfbc6759035dc24141fc402131.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_94b5c5efc95a08d21279276445778547.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_94b5c5efc95a08d21279276445778547.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_96e8f9686d20607f1bf24513ed4a5dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_96e8f9686d20607f1bf24513ed4a5dd3.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_637d2f2b265f407361555c981a906c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_637d2f2b265f407361555c981a906c7f.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_1394cb6cd8cd33ec5fb97ae75b3760a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_1394cb6cd8cd33ec5fb97ae75b3760a8.jpg already downloaded
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252Fec%252F7cecc125b4b9af8d73c2dba9d4b3db15%252Fpa%252FWH99295_230571191c8898291f8f075fdb118a0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_230571191c8898291f8f075fdb118a0e.jpg already downloaded
2026-03-30 12:28:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a998313-31fc-5f67-8844-419231905d98, identifier: WH99295
2026-03-30 12:28:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a998313-31fc-5f67-8844-419231905d98 with identifier: WH99295
2026-03-30 12:28:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a998313-31fc-5f67-8844-419231905d98 with identifier: WH99295
2026-03-30 12:28:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a998313-31fc-5f67-8844-419231905d98 with identifier: WH99295 to the API
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WH99295>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-03-31T15:20:06Z',
'fuel_type': 'petrol',
'id': '8a998313-31fc-5f67-8844-419231905d98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH99295',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 111941,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_2eafd5b280753d4e82ab223c932f8ef9.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_69ba9a8bdff3a8df34957e113b26760b.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_567458a9916fa25aa457fdbecd98a8a6.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_c36412f465cb10d36b20e50e864d92be.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_622225dfbc6759035dc24141fc402131.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_94b5c5efc95a08d21279276445778547.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_96e8f9686d20607f1bf24513ed4a5dd3.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_637d2f2b265f407361555c981a906c7f.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_1394cb6cd8cd33ec5fb97ae75b3760a8.jpg',
'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_230571191c8898291f8f075fdb118a0e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_2eafd5b280753d4e82ab223c932f8ef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2699696,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_69ba9a8bdff3a8df34957e113b26760b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2811478,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_567458a9916fa25aa457fdbecd98a8a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_c36412f465cb10d36b20e50e864d92be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_622225dfbc6759035dc24141fc402131.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_94b5c5efc95a08d21279276445778547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_96e8f9686d20607f1bf24513ed4a5dd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_637d2f2b265f407361555c981a906c7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738671,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_1394cb6cd8cd33ec5fb97ae75b3760a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a998313-31fc-5f67-8844-419231905d98/8a998313-31fc-5f67-8844-419231905d98_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/ec/7cecc125b4b9af8d73c2dba9d4b3db15/pa/WH99295_230571191c8898291f8f075fdb118a0e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-02',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Turbo SE Dynamic',
'transmission': 'automatic',
'trim': 'SE Dynamic',
'year': 2018}
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH99295%27 HTTP/1.1" 200 None
2026-03-30 12:28:21 [auto1.it] INFO: Saving data for WH99295: {'created_time': 1774873701.096645, 'last_price_update_time': 1774873701.096659, 'auction_closing_time': 1774970406.0}
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH99295') HTTP/1.1" 204 0
2026-03-30 12:28:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:28:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP07384> (referer: https://www.auto1.com/v1/car-details-view/FP07384/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a172c565-198e-556d-8d34-4ee67d3cd309 with identifier: FP07384
2026-03-30 12:28:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a172c565-198e-556d-8d34-4ee67d3cd309 with scrape type 1
2026-03-30 12:28:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_91512c07dd2634ead890e13623922d20.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_91512c07dd2634ead890e13623922d20.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_c9c34595443468dc4a05f398d8be3637.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_c9c34595443468dc4a05f398d8be3637.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_76a11ff624d0dbb40498a54fcee177da.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_76a11ff624d0dbb40498a54fcee177da.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg not downloaded yet
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg not downloaded yet
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_8bc385279e258be4a189e8c202654bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8bc385279e258be4a189e8c202654bfc.jpg not downloaded yet
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_91512c07dd2634ead890e13623922d20.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg not downloaded yet
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg not downloaded yet
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f60116d9c10>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f78450>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_91512c07dd2634ead890e13623922d20.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_91512c07dd2634ead890e13623922d20.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6011704950>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8bc385279e258be4a189e8c202654bfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_c9c34595443468dc4a05f398d8be3637.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_76a11ff624d0dbb40498a54fcee177da.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f78fd0>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b08e50>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fed7d0>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_8bc385279e258be4a189e8c202654bfc.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8bc385279e258be4a189e8c202654bfc.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012aff6d0>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_c9c34595443468dc4a05f398d8be3637.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_c9c34595443468dc4a05f398d8be3637.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010a94b50>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_76a11ff624d0dbb40498a54fcee177da.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_76a11ff624d0dbb40498a54fcee177da.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ff4710>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f63a90>
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe4%252F3ae408db2b90ef117e682b53179a79a8%252Fpa%252FFP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg saved to cache
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a172c565-198e-556d-8d34-4ee67d3cd309
2026-03-30 12:28:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a172c565-198e-556d-8d34-4ee67d3cd309, skipping ID generation
2026-03-30 12:28:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a172c565-198e-556d-8d34-4ee67d3cd309 with scrape type 1
2026-03-30 12:28:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a172c565-198e-556d-8d34-4ee67d3cd309 sending to next pipeline
2026-03-30 12:28:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a172c565-198e-556d-8d34-4ee67d3cd309, identifier: FP07384
2026-03-30 12:28:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a172c565-198e-556d-8d34-4ee67d3cd309 with identifier: FP07384
2026-03-30 12:28:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a172c565-198e-556d-8d34-4ee67d3cd309 with identifier: FP07384
2026-03-30 12:28:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a172c565-198e-556d-8d34-4ee67d3cd309 with identifier: FP07384 to the API
2026-03-30 12:28:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:40:46Z',
'fuel_type': 'gas',
'id': 'a172c565-198e-556d-8d34-4ee67d3cd309',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP07384',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Renault',
'model': 'Captur',
'odometer': 76438,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_ca68fad7ee4942fe05c4ff706a5af135.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_91512c07dd2634ead890e13623922d20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_d7d6ae5f6d6514fb9a94a5d907c78258.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_c9c34595443468dc4a05f398d8be3637.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_76a11ff624d0dbb40498a54fcee177da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5028bac51f667c860e3c63ba4c4a1a4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_55b7aca56f2a6da6c9cf2ff371633bf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8bc385279e258be4a189e8c202654bfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_8b9fa8c5b76c3ae0d0ba0091e4a8f0cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a172c565-198e-556d-8d34-4ee67d3cd309/a172c565-198e-556d-8d34-4ee67d3cd309_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/e4/3ae408db2b90ef117e682b53179a79a8/pa/FP07384_5834aabbbeffeb66e7432d2a6bd6216e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.0 TCe LPG Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2020}
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP07384%27 HTTP/1.1" 200 None
2026-03-30 12:28:26 [auto1.it] INFO: Saving data for FP07384: {'created_time': 1774873706.441206, 'last_price_update_time': 1774873706.441219, 'auction_closing_time': 1774971646.0}
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP07384') HTTP/1.1" 204 0
2026-03-30 12:28:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:37 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3586 | hits on page: 40
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: DR91409
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: BP95163
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: JV33372
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: UZ43487
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: JL77686
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JL77686%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for JL77686: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: AK61800
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK61800%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for AK61800: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: UG78231
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UG78231%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for UG78231: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: XR95165
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR95165%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for XR95165: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: PU84761
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU84761%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for PU84761: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: WR13144
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR13144%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for WR13144: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: KA38100
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA38100%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for KA38100: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: RC63187
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC63187%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for RC63187: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: CZ89669
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ89669%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for CZ89669: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: ZD15885
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: SR04366
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: EL85999
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EL85999%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for EL85999: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: BE54405
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: FG27064
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG27064%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for FG27064: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: YN38786
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN38786%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for YN38786: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: UN22377
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN22377%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for UN22377: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: MC43872
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC43872%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for MC43872: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: WY72702
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: TX80167
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: DP93203
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: YR35596
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR35596%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for YR35596: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: XA12696
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: NS88104
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS88104%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for NS88104: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: FL65861
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: VV86242
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: XJ13017
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13017%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for XJ13017: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: WJ94048
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: ZF45749
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF45749%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for ZF45749: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: HT40305
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT40305%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for HT40305: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: GS61581
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: XR52700
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR52700%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for XR52700: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: XR36455
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: VE63363
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE63363%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for VE63363: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: ZR86104
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR86104%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for ZR86104: 0
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: GV71970
2026-03-30 12:28:37 [auto1.it] INFO: Found listing with ID: YV17911
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV17911%27 HTTP/1.1" 200 None
2026-03-30 12:28:37 [auto1.it] INFO: Scrape type for YV17911: 0
2026-03-30 12:28:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU07097> (referer: https://www.auto1.com/v1/car-details-view/HU07097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with identifier: HU07097
2026-03-30 12:28:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with scrape type 1
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_3520bdbb946a37771b452a4976fb4a3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_3520bdbb946a37771b452a4976fb4a3e.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_adef6260309376673fa61b0ba22ef052.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_adef6260309376673fa61b0ba22ef052.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_7a159d45b315c73474f7d7352f43830b.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_7a159d45b315c73474f7d7352f43830b.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_0a33e89736142dbea60f43f0f436f910.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_0a33e89736142dbea60f43f0f436f910.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_9620cecfec5b28f7961f9feb14147c30.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_9620cecfec5b28f7961f9feb14147c30.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_726109982f677c54d8edc5ede7522162.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_726109982f677c54d8edc5ede7522162.jpg not downloaded yet
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_3520bdbb946a37771b452a4976fb4a3e.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_adef6260309376673fa61b0ba22ef052.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_c95461ac41fb3704df8148532f2a32aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_c95461ac41fb3704df8148532f2a32aa.jpg not downloaded yet
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_4f4a887a96689808378e66562265aac8.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_4f4a887a96689808378e66562265aac8.jpg not downloaded yet
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg not downloaded yet
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_c95461ac41fb3704df8148532f2a32aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f87090>
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_0.jpg HTTP/1.1" 201 0
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_3520bdbb946a37771b452a4976fb4a3e.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_3520bdbb946a37771b452a4976fb4a3e.jpg saved to cache
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_726109982f677c54d8edc5ede7522162.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_0a33e89736142dbea60f43f0f436f910.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003ea8f10>
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_1.jpg HTTP/1.1" 201 0
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_adef6260309376673fa61b0ba22ef052.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_adef6260309376673fa61b0ba22ef052.jpg saved to cache
2026-03-30 12:28:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_4f4a887a96689808378e66562265aac8.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_7a159d45b315c73474f7d7352f43830b.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_9620cecfec5b28f7961f9feb14147c30.jpg> (referer: https://www.auto1.com/)
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003fb9150>
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_2.jpg HTTP/1.1" 201 0
2026-03-30 12:28:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012820d90>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_7.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_c95461ac41fb3704df8148532f2a32aa.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_c95461ac41fb3704df8148532f2a32aa.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f41250>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_6.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_726109982f677c54d8edc5ede7522162.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_726109982f677c54d8edc5ede7522162.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6010934090>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_4.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_0a33e89736142dbea60f43f0f436f910.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_0a33e89736142dbea60f43f0f436f910.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6012b00210>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_8.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_4f4a887a96689808378e66562265aac8.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_4f4a887a96689808378e66562265aac8.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f67b10>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_3.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_7a159d45b315c73474f7d7352f43830b.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_7a159d45b315c73474f7d7352f43830b.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f57c50>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_9.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6003f65490>
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 12:28:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_5.jpg HTTP/1.1" 201 0
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571daa0427a38b80f0d5070ab21822ac%252Fpa%252FHU07097_9620cecfec5b28f7961f9feb14147c30.jpg') HTTP/1.1" 204 0
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_9620cecfec5b28f7961f9feb14147c30.jpg saved to cache
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff
2026-03-30 12:28:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff, skipping ID generation
2026-03-30 12:28:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with scrape type 1
2026-03-30 12:28:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a27fcb6e-75e8-5b6b-b6b4-05df5a380eff sending to next pipeline
2026-03-30 12:28:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff, identifier: HU07097
2026-03-30 12:28:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with identifier: HU07097
2026-03-30 12:28:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with identifier: HU07097
2026-03-30 12:28:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a27fcb6e-75e8-5b6b-b6b4-05df5a380eff with identifier: HU07097 to the API
2026-03-30 12:28:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_9620cecfec5b28f7961f9feb14147c30.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6C',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:40:15Z',
'fuel_type': 'diesel',
'id': 'a27fcb6e-75e8-5b6b-b6b4-05df5a380eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU07097',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'make': 'BMW',
'model': '4er',
'odometer': 243774,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_3520bdbb946a37771b452a4976fb4a3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_adef6260309376673fa61b0ba22ef052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_ef88930b4f0c49e17af8cb7788bc2869.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_7a159d45b315c73474f7d7352f43830b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_0a33e89736142dbea60f43f0f436f910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_9620cecfec5b28f7961f9feb14147c30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_726109982f677c54d8edc5ede7522162.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_c95461ac41fb3704df8148532f2a32aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_4f4a887a96689808378e66562265aac8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a27fcb6e-75e8-5b6b-b6b4-05df5a380eff/a27fcb6e-75e8-5b6b-b6b4-05df5a380eff_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571daa0427a38b80f0d5070ab21822ac/pa/HU07097_171b61c0f7e1634b1443e71e3dec81ac.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 4er 420d Gran Coupé xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2020}
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU07097%27 HTTP/1.1" 200 None
2026-03-30 12:28:44 [auto1.it] INFO: Saving data for HU07097: {'created_time': 1774873724.649238, 'last_price_update_time': 1774873724.649249, 'auction_closing_time': 1774971615.0}
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU07097') HTTP/1.1" 204 0
2026-03-30 12:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY93088> (referer: https://www.auto1.com/v1/car-details-view/VY93088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5453d64-7f24-5598-b33b-c39e283cfb5a with identifier: VY93088
2026-03-30 12:28:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5453d64-7f24-5598-b33b-c39e283cfb5a with scrape type 1
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5453d64-7f24-5598-b33b-c39e283cfb5a
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_34e68195e708aaf3a25c886983f047d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_34e68195e708aaf3a25c886983f047d7.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_9e20fcb3ef443ca3a1997fd12ca04c20.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_9e20fcb3ef443ca3a1997fd12ca04c20.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_f16f253fd637093ebb1da15b3269c58d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_f16f253fd637093ebb1da15b3269c58d.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_dbead93f4018ee52a13be4ad819035d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_dbead93f4018ee52a13be4ad819035d4.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_a70e56bc824de00eddb64fcae64cfa1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_a70e56bc824de00eddb64fcae64cfa1c.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_4bad383aed64bc12100bf7c0e9c4f4bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_4bad383aed64bc12100bf7c0e9c4f4bf.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_b004b098a761f0c3a228b9f19601452d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b004b098a761f0c3a228b9f19601452d.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_286406f56002fc1a72ca505d50e7ebd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_286406f56002fc1a72ca505d50e7ebd7.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_b87912e3d0b2cc4e963562f4a7c29ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b87912e3d0b2cc4e963562f4a7c29ce1.jpg already downloaded
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa3%252Fe8a36aa51be467996634905ff8e6b8d4%252Fpa%252FVY93088_ace65c7b52647977cf0aea86c300eebe.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:28:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_ace65c7b52647977cf0aea86c300eebe.jpg already downloaded
2026-03-30 12:28:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5453d64-7f24-5598-b33b-c39e283cfb5a, identifier: VY93088
2026-03-30 12:28:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5453d64-7f24-5598-b33b-c39e283cfb5a with identifier: VY93088
2026-03-30 12:28:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5453d64-7f24-5598-b33b-c39e283cfb5a with identifier: VY93088
2026-03-30 12:28:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5453d64-7f24-5598-b33b-c39e283cfb5a with identifier: VY93088 to the API
2026-03-30 12:28:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:28:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY93088>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:13:18Z',
'fuel_type': 'diesel',
'id': 'b5453d64-7f24-5598-b33b-c39e283cfb5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY93088',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 56964,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_34e68195e708aaf3a25c886983f047d7.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_9e20fcb3ef443ca3a1997fd12ca04c20.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_f16f253fd637093ebb1da15b3269c58d.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_dbead93f4018ee52a13be4ad819035d4.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_a70e56bc824de00eddb64fcae64cfa1c.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_4bad383aed64bc12100bf7c0e9c4f4bf.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b004b098a761f0c3a228b9f19601452d.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_286406f56002fc1a72ca505d50e7ebd7.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b87912e3d0b2cc4e963562f4a7c29ce1.jpg',
'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_ace65c7b52647977cf0aea86c300eebe.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2220105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_34e68195e708aaf3a25c886983f047d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_9e20fcb3ef443ca3a1997fd12ca04c20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041342,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_f16f253fd637093ebb1da15b3269c58d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1732247,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_dbead93f4018ee52a13be4ad819035d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_a70e56bc824de00eddb64fcae64cfa1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2100246,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_4bad383aed64bc12100bf7c0e9c4f4bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b004b098a761f0c3a228b9f19601452d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2183213,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_286406f56002fc1a72ca505d50e7ebd7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063142,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_b87912e3d0b2cc4e963562f4a7c29ce1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5453d64-7f24-5598-b33b-c39e283cfb5a/b5453d64-7f24-5598-b33b-c39e283cfb5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2138716,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge8/a3/e8a36aa51be467996634905ff8e6b8d4/pa/VY93088_ace65c7b52647977cf0aea86c300eebe.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.6 CRDi Classic 2WD',
'transmission': 'manual',
'trim': 'Classic 2WD',
'year': 2019}
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY93088%27 HTTP/1.1" 200 None
2026-03-30 12:28:52 [auto1.it] INFO: Saving data for VY93088: {'created_time': 1774873732.594264, 'last_price_update_time': 1774873732.594275, 'auction_closing_time': 1774969998.0}
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY93088') HTTP/1.1" 204 0
2026-03-30 12:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:57 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3588 | hits on page: 40
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: GV71970
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: YV17911
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV17911%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for YV17911: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: AL80929
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL80929%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for AL80929: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: ZH19388
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: UF13738
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for UF13738: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: RC10955
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC10955%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for RC10955: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: ZE75759
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE75759%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for ZE75759: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: RA18546
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA18546%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for RA18546: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: FM86422
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM86422%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for FM86422: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: PW67312
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW67312%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for PW67312: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: KA76603
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA76603%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for KA76603: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: DA30561
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA30561%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for DA30561: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: UW57613
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: KJ64307
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ64307%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for KJ64307: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: FL99970
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: NF28136
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: BB99358
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: BW52092
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW52092%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for BW52092: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: CF64613
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF64613%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for CF64613: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: TF93411
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF93411%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for TF93411: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: LX38912
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: JZ25588
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: YU05925
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU05925%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for YU05925: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: MA72760
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: EC41125
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC41125%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for EC41125: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: JU77686
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU77686%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for JU77686: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: YM60630
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: CF41480
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: AL20589
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL20589%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for AL20589: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: MR16221
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR16221%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for MR16221: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: MZ19465
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ19465%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for MZ19465: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: KL21440
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: XJ15185
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ15185%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for XJ15185: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: FW53113
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW53113%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for FW53113: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: AX14141
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: NB05481
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: CW23076
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23076%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for CW23076: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: PP58760
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: DW47560
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW47560%27 HTTP/1.1" 200 None
2026-03-30 12:28:57 [auto1.it] INFO: Scrape type for DW47560: 0
2026-03-30 12:28:57 [auto1.it] INFO: Found listing with ID: UB63640
2026-03-30 12:28:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:28:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:28:59 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3588 | hits on page: 40
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: SY30215
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY30215%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.it] INFO: Scrape type for SY30215: 0
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: GM45638
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: LA34369
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA34369%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.it] INFO: Scrape type for LA34369: 0
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: KB21733
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB21733%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.it] INFO: Scrape type for KB21733: 0
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: ZZ37544
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: HP37847
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: FK67266
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:28:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK67266%27 HTTP/1.1" 200 None
2026-03-30 12:28:59 [auto1.it] INFO: Scrape type for FK67266: 0
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: AH42786
2026-03-30 12:28:59 [auto1.it] INFO: Found listing with ID: RV38017
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV38017%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for RV38017: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: JK64224
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: CL10517
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: BK72599
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK72599%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for BK72599: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: NP53767
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: PZ28359
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: VA85498
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: CW61411
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: VN45721
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN45721%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for VN45721: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: FJ15819
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: RX35107
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX35107%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for RX35107: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: LH23516
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: GZ60590
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for GZ60590: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: FD90362
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD90362%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for FD90362: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: YA01979
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA01979%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for YA01979: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: EP59254
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP59254%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for EP59254: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: NR09565
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: VU13250
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: HT52131
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: CM15211
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM15211%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for CM15211: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: ZM54486
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: SV41912
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: JA46971
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46971%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for JA46971: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: AV22109
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: CK19595
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: KY08376
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: JP33572
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP33572%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for JP33572: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: WY43100
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY43100%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for WY43100: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: FF00000
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: YH99570
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH99570%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for YH99570: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: UF18413
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF18413%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for UF18413: 0
2026-03-30 12:29:00 [auto1.it] INFO: Found listing with ID: EY30987
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY30987%27 HTTP/1.1" 200 None
2026-03-30 12:29:00 [auto1.it] INFO: Scrape type for EY30987: 0
2026-03-30 12:29:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:01 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: WF75031
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF75031%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for WF75031: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: ST73163
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST73163%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for ST73163: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: AP34592
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: SC36989
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC36989%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for SC36989: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: SB02789
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB02789%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for SB02789: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: JY89791
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY89791%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for JY89791: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: JW12338
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: NM25004
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM25004%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for NM25004: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: KE87600
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: GK84881
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK84881%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for GK84881: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: UT34552
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT34552%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for UT34552: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: RJ74890
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ74890%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for RJ74890: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: DK43597
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: HY55769
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY55769%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for HY55769: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: LJ03272
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: BW98785
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW98785%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for BW98785: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: MN95731
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN95731%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for MN95731: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: BD07482
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD07482%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for BD07482: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: FK09468
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK09468%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for FK09468: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: WR41361
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR41361%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for WR41361: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: RP34917
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RP34917%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for RP34917: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: BX26430
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX26430%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for BX26430: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: VB85022
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: SP78174
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP78174%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for SP78174: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: KY18822
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY18822%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for KY18822: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: RL10918
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: WL49427
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL49427%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for WL49427: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: EL74502
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: MY36901
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: FD49777
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: FX24983
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX24983%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for FX24983: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: DN10540
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN10540%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for DN10540: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: TB83381
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB83381%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for TB83381: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: JZ33949
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ33949%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for JZ33949: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: VM11321
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM11321%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for VM11321: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: KL91026
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL91026%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for KL91026: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: GD21470
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: LX69151
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: SW80726
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW80726%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for SW80726: 0
2026-03-30 12:29:01 [auto1.it] INFO: Found listing with ID: ZL23627
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL23627%27 HTTP/1.1" 200 None
2026-03-30 12:29:01 [auto1.it] INFO: Scrape type for ZL23627: 0
2026-03-30 12:29:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:03 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: YA27479
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA27479%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for YA27479: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: RA21109
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: DE35632
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: NU69507
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: WE26685
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE26685%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for WE26685: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: ME48508
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: LV15900
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: NV20276
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: MA55202
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA55202%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for MA55202: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: TH12269
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12269%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for TH12269: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: EE49908
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: XV48493
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV48493%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for XV48493: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: KS95421
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS95421%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for KS95421: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: DF93704
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF93704%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for DF93704: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: GE96866
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE96866%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for GE96866: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: TE47811
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47811%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for TE47811: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: LK09614
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: HU36164
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: YX59353
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: GR02262
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR02262%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for GR02262: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: PF04390
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: DS64702
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: MY23497
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: WL38186
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL38186%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for WL38186: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: JT52337
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: RX09361
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX09361%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for RX09361: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: XR03197
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: SJ27084
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: LF83969
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: GA52227
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA52227%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for GA52227: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: DS88092
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: KC09537
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC09537%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for KC09537: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: NY59521
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: KU76175
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KU76175%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for KU76175: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: ZT54121
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT54121%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for ZT54121: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: HW13638
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: VP28061
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: HP25104
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP25104%27 HTTP/1.1" 200 None
2026-03-30 12:29:03 [auto1.it] INFO: Scrape type for HP25104: 0
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: FX22483
2026-03-30 12:29:03 [auto1.it] INFO: Found listing with ID: VW75885
2026-03-30 12:29:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:04 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 14 pages/min), scraped 133 items (at 8 items/min)
2026-03-30 12:29:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:29:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:04 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: ZB56283
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: ZD91383
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD91383%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for ZD91383: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: UY37095
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY37095%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for UY37095: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: PY44760
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY44760%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for PY44760: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: GY68527
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY68527%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for GY68527: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: ES04012
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES04012%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for ES04012: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: SY55940
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: YK56738
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK56738%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for YK56738: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: UM22430
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: HF31411
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: TL80990
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL80990%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for TL80990: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: DG05029
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG05029%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for DG05029: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: SB43927
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: DW74662
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW74662%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for DW74662: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: PV19108
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV19108%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for PV19108: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: RT37203
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: DA96064
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA96064%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for DA96064: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: SD84714
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD84714%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for SD84714: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: CY17500
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: WE25816
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE25816%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for WE25816: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: RV54155
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV54155%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for RV54155: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: XX98106
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX98106%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for XX98106: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: YJ98876
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: LP02443
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: MH70269
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH70269%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for MH70269: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: VC90612
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: YX73536
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: WT52400
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: ZZ91306
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: HS01287
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01287%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for HS01287: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: AE23716
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: FY27502
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: BX11661
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: FV31205
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: GN01544
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN01544%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for GN01544: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: KT03985
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: TM60577
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: AK38143
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK38143%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for AK38143: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: AS05452
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS05452%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for AS05452: 0
2026-03-30 12:29:04 [auto1.it] INFO: Found listing with ID: SC61434
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC61434%27 HTTP/1.1" 200 None
2026-03-30 12:29:04 [auto1.it] INFO: Scrape type for SC61434: 0
2026-03-30 12:29:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:06 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.924(s), this was the 1st time calling it.
2026-03-30 12:29:06 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.388616279579457 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:29:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:07 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: UH38063
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: RR79124
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: EW60341
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW60341%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for EW60341: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: WX27288
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: LC66242
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: EY48329
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY48329%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for EY48329: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: FY08394
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: RU39980
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: BV54558
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV54558%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for BV54558: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: HW76597
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW76597%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for HW76597: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: NL09316
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL09316%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for NL09316: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: AK10390
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: KS82343
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: RU60792
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU60792%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for RU60792: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: UK67498
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK67498%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for UK67498: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: XM02393
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: BY67467
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: GZ67073
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ67073%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for GZ67073: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: SH29358
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH29358%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for SH29358: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: WU93186
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU93186%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for WU93186: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: CH55121
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH55121%27 HTTP/1.1" 200 None
2026-03-30 12:29:07 [auto1.it] INFO: Scrape type for CH55121: 0
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: NK12319
2026-03-30 12:29:07 [auto1.it] INFO: Found listing with ID: EZ69739
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ69739%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for EZ69739: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: ZX52658
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX52658%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for ZX52658: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: LY23963
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: VR96583
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR96583%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for VR96583: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: VY18812
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: GT94067
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: YZ93914
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: PK23396
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: VY79198
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: PS15359
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: LZ12908
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: SP98700
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP98700%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for SP98700: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: CZ74992
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ74992%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for CZ74992: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: LW85334
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW85334%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for LW85334: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: LP18023
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP18023%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for LP18023: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: WE89582
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE89582%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for WE89582: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: MZ33664
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ33664%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for MZ33664: 0
2026-03-30 12:29:08 [auto1.it] INFO: Found listing with ID: EA17133
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA17133%27 HTTP/1.1" 200 None
2026-03-30 12:29:08 [auto1.it] INFO: Scrape type for EA17133: 0
2026-03-30 12:29:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:10 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: NL70600
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL70600%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.it] INFO: Scrape type for NL70600: 0
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: YV46524
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: AU20184
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU20184%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.it] INFO: Scrape type for AU20184: 0
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: TN90495
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN90495%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.it] INFO: Scrape type for TN90495: 0
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: SK44334
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: JH80469
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH80469%27 HTTP/1.1" 200 None
2026-03-30 12:29:10 [auto1.it] INFO: Scrape type for JH80469: 0
2026-03-30 12:29:10 [auto1.it] INFO: Found listing with ID: HZ78345
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ78345%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for HZ78345: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: TE89660
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE89660%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for TE89660: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: PK52051
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK52051%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for PK52051: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: UB72934
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: RB69324
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: PN79982
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: YT69462
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT69462%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for YT69462: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: JA78037
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: PY49742
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY49742%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for PY49742: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: ZZ84450
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84450%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for ZZ84450: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: AS63224
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: JH99386
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: AA10664
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA10664%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for AA10664: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: WS56661
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WS56661%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for WS56661: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: EU06548
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU06548%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for EU06548: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: AM15207
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: NR20429
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR20429%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for NR20429: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: YJ46375
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: MR49146
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR49146%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for MR49146: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: FY24285
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: AK03087
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK03087%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for AK03087: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: EY99880
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY99880%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for EY99880: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: SK14741
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: DS55182
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: TW09366
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW09366%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for TW09366: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: RG52060
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG52060%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for RG52060: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: GX31313
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX31313%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for GX31313: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: CH15776
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: YE07599
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE07599%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for YE07599: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: MS41612
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: HK97988
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: BN09634
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN09634%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for BN09634: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: VS38043
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS38043%27 HTTP/1.1" 200 None
2026-03-30 12:29:11 [auto1.it] INFO: Scrape type for VS38043: 0
2026-03-30 12:29:11 [auto1.it] INFO: Found listing with ID: ZF95958
2026-03-30 12:29:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:12 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 3588 | hits on page: 40
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: GD26025
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD26025%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for GD26025: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: PN24411
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: RN34673
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN34673%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for RN34673: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SJ91765
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ91765%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for SJ91765: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: ZP51405
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: PE97517
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UE49682
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UK55299
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: HY22181
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22181%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for HY22181: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: MT61619
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SX71536
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX71536%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for SX71536: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: ZF01479
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF01479%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for ZF01479: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: ZD65327
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD65327%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for ZD65327: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UY95940
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: KF98112
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF98112%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for KF98112: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SP08932
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: LX93487
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SE28120
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE28120%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for SE28120: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: RZ71540
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: LZ42897
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: WV68321
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UL18238
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL18238%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for UL18238: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: FW39632
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW39632%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for FW39632: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: GW20152
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: ZK24441
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: PE82748
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SJ10384
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: PT71441
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT71441%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for PT71441: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: DZ81200
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ81200%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for DZ81200: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: BJ35164
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: YY05458
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: PL88516
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL88516%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for PL88516: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UY23152
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: SC57699
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for SC57699: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: RK33520
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK33520%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for RK33520: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: UP66451
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP66451%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for UP66451: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: AE31904
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE31904%27 HTTP/1.1" 200 None
2026-03-30 12:29:12 [auto1.it] INFO: Scrape type for AE31904: 0
2026-03-30 12:29:12 [auto1.it] INFO: Found listing with ID: YD69263
2026-03-30 12:29:13 [auto1.it] INFO: Found listing with ID: ZR63557
2026-03-30 12:29:13 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-30 12:29:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:21 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 3589 | hits on page: 40
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: ZH41426
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: EB41992
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: ZU58550
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: BF27617
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: WU44715
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU44715%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for WU44715: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: EN03820
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN03820%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for EN03820: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: GW95975
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for GW95975: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: JE32624
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE32624%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for JE32624: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: NG07362
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG07362%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for NG07362: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: CM62235
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM62235%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for CM62235: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: VJ49724
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: SK65228
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: YY30219
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY30219%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for YY30219: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: CE85446
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE85446%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for CE85446: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: HU51059
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: XN46207
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN46207%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for XN46207: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: WX63891
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX63891%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for WX63891: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: KM32276
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: PD42328
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD42328%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for PD42328: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: XT99009
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: EN15125
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN15125%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for EN15125: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: KD47428
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD47428%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for KD47428: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: EW53472
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW53472%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for EW53472: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: FB83790
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB83790%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for FB83790: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: HU20333
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: RA62003
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: PX43587
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX43587%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for PX43587: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: KE18489
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE18489%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for KE18489: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: CE26038
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE26038%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for CE26038: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: ZG72619
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: JR23231
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: JJ67638
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ67638%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for JJ67638: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: GT84343
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT84343%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for GT84343: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: UX25777
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX25777%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for UX25777: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: HH27298
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH27298%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for HH27298: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: GY59997
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: LR66295
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66295%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for LR66295: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: JG07033
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG07033%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for JG07033: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-30 12:29:21 [auto1.it] INFO: Scrape type for PF84937: 0
2026-03-30 12:29:21 [auto1.it] INFO: Found listing with ID: FL66155
2026-03-30 12:29:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:27 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.984(s), this was the 1st time calling it.
2026-03-30 12:29:27 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.59755179227672 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:29:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR90993> (referer: https://www.auto1.com/v1/car-details-view/PR90993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae85356e-e96c-5731-b370-2eaa4c64d2d3 with identifier: PR90993
2026-03-30 12:29:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae85356e-e96c-5731-b370-2eaa4c64d2d3 with scrape type 1
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae85356e-e96c-5731-b370-2eaa4c64d2d3
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_76c0c2fc1ffa60154e587137c554d76f.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_76c0c2fc1ffa60154e587137c554d76f.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_281dd23c141df9a72557178c825674e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_281dd23c141df9a72557178c825674e3.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_473031339f55c93212ba627de3a3f3c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_473031339f55c93212ba627de3a3f3c9.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_196cfa65d6124f6b59e6872a95f5d46a.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_196cfa65d6124f6b59e6872a95f5d46a.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_8789d0acd00dbe91f291a75efb962213.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8789d0acd00dbe91f291a75efb962213.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_a2d4fa23db600a81eb48fc49afc393e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_a2d4fa23db600a81eb48fc49afc393e4.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_77c941ba3ad1ce85a911023f98ab0ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_77c941ba3ad1ce85a911023f98ab0ab3.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_8206078baa4a8153fb4362f27863c2db.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8206078baa4a8153fb4362f27863c2db.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_e6d618f8b12fce642347caf447cf0c9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_e6d618f8b12fce642347caf447cf0c9c.jpg already downloaded
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Ffe%252Feafee9cc195b392ba9e66767edb7d5af%252Fpa%252FPR90993_29041bb496e4ba1e40b03be6e398f1fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_29041bb496e4ba1e40b03be6e398f1fc.jpg already downloaded
2026-03-30 12:29:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae85356e-e96c-5731-b370-2eaa4c64d2d3, identifier: PR90993
2026-03-30 12:29:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae85356e-e96c-5731-b370-2eaa4c64d2d3 with identifier: PR90993
2026-03-30 12:29:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae85356e-e96c-5731-b370-2eaa4c64d2d3 with identifier: PR90993
2026-03-30 12:29:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae85356e-e96c-5731-b370-2eaa4c64d2d3 with identifier: PR90993 to the API
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR90993>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:55:53Z',
'fuel_type': 'diesel',
'id': 'ae85356e-e96c-5731-b370-2eaa4c64d2d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR90993',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 34740,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_76c0c2fc1ffa60154e587137c554d76f.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_281dd23c141df9a72557178c825674e3.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_473031339f55c93212ba627de3a3f3c9.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_196cfa65d6124f6b59e6872a95f5d46a.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8789d0acd00dbe91f291a75efb962213.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_a2d4fa23db600a81eb48fc49afc393e4.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_77c941ba3ad1ce85a911023f98ab0ab3.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8206078baa4a8153fb4362f27863c2db.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_e6d618f8b12fce642347caf447cf0c9c.jpg',
'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_29041bb496e4ba1e40b03be6e398f1fc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_76c0c2fc1ffa60154e587137c554d76f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_281dd23c141df9a72557178c825674e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_473031339f55c93212ba627de3a3f3c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_196cfa65d6124f6b59e6872a95f5d46a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3132975,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8789d0acd00dbe91f291a75efb962213.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3150178,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_a2d4fa23db600a81eb48fc49afc393e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_77c941ba3ad1ce85a911023f98ab0ab3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3429313,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_8206078baa4a8153fb4362f27863c2db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3385282,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_e6d618f8b12fce642347caf447cf0c9c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae85356e-e96c-5731-b370-2eaa4c64d2d3/ae85356e-e96c-5731-b370-2eaa4c64d2d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/fe/eafee9cc195b392ba9e66767edb7d5af/pa/PR90993_29041bb496e4ba1e40b03be6e398f1fc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-11-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi Equilibre',
'transmission': 'automatic',
'trim': 'Equilibre',
'year': 2022}
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR90993%27 HTTP/1.1" 200 None
2026-03-30 12:29:35 [auto1.it] INFO: Saving data for PR90993: {'created_time': 1774873775.867792, 'last_price_update_time': 1774873775.867804, 'auction_closing_time': 1774972553.0}
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR90993') HTTP/1.1" 204 0
2026-03-30 12:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:42 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 3591 | hits on page: 40
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: PF84937
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF84937%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for PF84937: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: FL66155
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: EX40669
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX40669%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for EX40669: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: PP82973
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP82973%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for PP82973: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: PP47807
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP47807%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for PP47807: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: JV22884
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV22884%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for JV22884: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: ZU45449
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU45449%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for ZU45449: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: CU36699
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU36699%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for CU36699: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: ZV41992
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV41992%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for ZV41992: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: PG97682
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: VF12324
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: XR25970
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: HE03479
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: EU76954
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: VG29105
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: VW71649
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: DG11990
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG11990%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for DG11990: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: FC87594
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: VC96315
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: WN10249
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN10249%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for WN10249: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: AD85464
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: YW84907
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW84907%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for YW84907: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: SP63067
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: JH15669
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: YZ52135
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: RT96174
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT96174%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for RT96174: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: ZM37074
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM37074%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for ZM37074: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: XU27614
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: TN93394
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN93394%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for TN93394: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: KT64374
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: SN21626
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN21626%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for SN21626: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: SJ75121
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ75121%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for SJ75121: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: PP13796
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP13796%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for PP13796: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: YM04442
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM04442%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for YM04442: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: DW64097
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW64097%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for DW64097: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: BG87604
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG87604%27 HTTP/1.1" 200 None
2026-03-30 12:29:42 [auto1.it] INFO: Scrape type for BG87604: 0
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: AN44803
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: TU77617
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: KP13165
2026-03-30 12:29:42 [auto1.it] INFO: Found listing with ID: ZZ51867
2026-03-30 12:29:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:44 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 3592 | hits on page: 40
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: ZZ51867
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: SZ37038
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ37038%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for SZ37038: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: WV29949
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: DA44533
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44533%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for DA44533: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: DX20771
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: TU90316
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: EE84208
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE84208%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for EE84208: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: GZ10906
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: MX50027
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: PH85251
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH85251%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for PH85251: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: HG99110
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG99110%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for HG99110: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: LS67474
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS67474%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for LS67474: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: WG28581
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: NN97027
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: TD45829
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD45829%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for TD45829: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: FH22196
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: LC35627
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: MB23093
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB23093%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for MB23093: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: GS44368
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS44368%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for GS44368: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: SC01107
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: PV08613
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: PH30098
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: DW05477
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: XT15481
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: AL46082
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: AF16570
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF16570%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for AF16570: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: CE09318
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: MG39360
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG39360%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for MG39360: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: NC77836
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC77836%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for NC77836: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: BM94525
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: TT40811
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: WJ69622
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ69622%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for WJ69622: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: SD48843
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD48843%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for SD48843: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: GG46120
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG46120%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for GG46120: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: EV67408
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67408%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for EV67408: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: SC05830
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05830%27 HTTP/1.1" 200 None
2026-03-30 12:29:44 [auto1.it] INFO: Scrape type for SC05830: 0
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: EC33452
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: KZ82470
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: CV62006
2026-03-30 12:29:44 [auto1.it] INFO: Found listing with ID: GU28571
2026-03-30 12:29:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF68362> (referer: https://www.auto1.com/v1/car-details-view/ZF68362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:29:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac2faf13-5f69-509c-a6a2-1376c3e263bf with identifier: ZF68362
2026-03-30 12:29:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac2faf13-5f69-509c-a6a2-1376c3e263bf with scrape type 1
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ac2faf13-5f69-509c-a6a2-1376c3e263bf
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F86%252F27860627d043501bade876f9b9759c7c%252Fpa%252FZF68362_3d97a24082f9800db8d6697b3387089d.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_3d97a24082f9800db8d6697b3387089d.jpg already downloaded
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F86%252F27860627d043501bade876f9b9759c7c%252Fpa%252FZF68362_07abad030ce6a8655e0e92c8f00bd804.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_07abad030ce6a8655e0e92c8f00bd804.jpg already downloaded
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F86%252F27860627d043501bade876f9b9759c7c%252Fpa%252FZF68362_820981d19133f3653106b1f6d809ccfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_820981d19133f3653106b1f6d809ccfc.jpg already downloaded
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F86%252F27860627d043501bade876f9b9759c7c%252Fpa%252FZF68362_53eaef6e08f23058420328f0495e3e42.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_53eaef6e08f23058420328f0495e3e42.jpg already downloaded
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F86%252F27860627d043501bade876f9b9759c7c%252Fpa%252FZF68362_5e837d26054e93318367276c6103f042.jpg%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_5e837d26054e93318367276c6103f042.jpg already downloaded
2026-03-30 12:29:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac2faf13-5f69-509c-a6a2-1376c3e263bf, identifier: ZF68362
2026-03-30 12:29:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac2faf13-5f69-509c-a6a2-1376c3e263bf with identifier: ZF68362
2026-03-30 12:29:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac2faf13-5f69-509c-a6a2-1376c3e263bf with identifier: ZF68362
2026-03-30 12:29:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac2faf13-5f69-509c-a6a2-1376c3e263bf with identifier: ZF68362 to the API
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:29:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF68362>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:45:09Z',
'fuel_type': 'petrol',
'id': 'ac2faf13-5f69-509c-a6a2-1376c3e263bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF68362',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Suzuki',
'model': 'Alto',
'odometer': 79755,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_3d97a24082f9800db8d6697b3387089d.jpg',
'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_07abad030ce6a8655e0e92c8f00bd804.jpg',
'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_820981d19133f3653106b1f6d809ccfc.jpg',
'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_53eaef6e08f23058420328f0495e3e42.jpg',
'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_5e837d26054e93318367276c6103f042.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2faf13-5f69-509c-a6a2-1376c3e263bf/ac2faf13-5f69-509c-a6a2-1376c3e263bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_3d97a24082f9800db8d6697b3387089d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2faf13-5f69-509c-a6a2-1376c3e263bf/ac2faf13-5f69-509c-a6a2-1376c3e263bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_07abad030ce6a8655e0e92c8f00bd804.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2faf13-5f69-509c-a6a2-1376c3e263bf/ac2faf13-5f69-509c-a6a2-1376c3e263bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_820981d19133f3653106b1f6d809ccfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2faf13-5f69-509c-a6a2-1376c3e263bf/ac2faf13-5f69-509c-a6a2-1376c3e263bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_53eaef6e08f23058420328f0495e3e42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac2faf13-5f69-509c-a6a2-1376c3e263bf/ac2faf13-5f69-509c-a6a2-1376c3e263bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/86/27860627d043501bade876f9b9759c7c/pa/ZF68362_5e837d26054e93318367276c6103f042.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-06-19',
'seats_number': 4,
'seller_name': None,
'title': 'Suzuki Alto 1.0 GL',
'transmission': 'manual',
'trim': 'GL',
'year': 2013}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF68362%27 HTTP/1.1" 200 None
2026-03-30 12:29:47 [auto1.it] INFO: Saving data for ZF68362: {'created_time': 1774873787.723674, 'last_price_update_time': 1774873787.723684, 'auction_closing_time': 1774971909.0}
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF68362') HTTP/1.1" 204 0
2026-03-30 12:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:01 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: JR58034
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR58034%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for JR58034: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: BV26472
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: CE19037
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE19037%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for CE19037: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: LS03457
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS03457%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for LS03457: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: PS14432
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS14432%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for PS14432: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: SZ24732
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: PR58597
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: ME44881
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for ME44881: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: JL83734
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: VV47439
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: BX20642
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: SP39094
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: LC22701
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: VZ29537
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ29537%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for VZ29537: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: RX33676
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: AX27463
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: CD12449
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: MB91559
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for MB91559: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: JZ26894
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: UN95232
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN95232%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for UN95232: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: ZB83520
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB83520%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for ZB83520: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: WT68186
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT68186%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for WT68186: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: JR03068
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR03068%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for JR03068: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: PF40120
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: PV06948
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV06948%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for PV06948: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: LY05485
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY05485%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for LY05485: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: LS46243
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS46243%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for LS46243: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: WV48837
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV48837%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for WV48837: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: DC26053
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC26053%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for DC26053: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: JZ95441
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ95441%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for JZ95441: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: VP93910
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP93910%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for VP93910: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: DR82900
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: FN72071
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN72071%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for FN72071: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: WH56731
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH56731%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for WH56731: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: YN65512
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: PB31965
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PB31965%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for PB31965: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: MB79295
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB79295%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for MB79295: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: MD54154
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD54154%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for MD54154: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: XY70829
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY70829%27 HTTP/1.1" 200 None
2026-03-30 12:30:01 [auto1.it] INFO: Scrape type for XY70829: 0
2026-03-30 12:30:01 [auto1.it] INFO: Found listing with ID: DD76151
2026-03-30 12:30:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:04 [scrapy.extensions.logstats] INFO: Crawled 236 pages (at 10 pages/min), scraped 135 items (at 2 items/min)
2026-03-30 12:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:18 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:18 [auto1.it] INFO: Found listing with ID: DD76151
2026-03-30 12:30:18 [auto1.it] INFO: Found listing with ID: RX26754
2026-03-30 12:30:18 [auto1.it] INFO: Found listing with ID: BE00286
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE00286%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for BE00286: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: ZA41096
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA41096%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for ZA41096: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: UK52269
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK52269%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for UK52269: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: US42415
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US42415%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for US42415: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: GM47184
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM47184%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for GM47184: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: LA93311
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MD20414
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: YF99217
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: TM85458
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: CL69303
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL69303%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for CL69303: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: NA96528
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA96528%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for NA96528: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: JU96754
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: UH68033
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: PC80500
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: DU75203
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: RK56494
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: WG31996
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG31996%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for WG31996: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: HB38869
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: YN37563
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: LT20322
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT20322%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for LT20322: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: VV14244
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV14244%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for VV14244: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: VK01917
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MH41109
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MJ72891
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ72891%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for MJ72891: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: YX27089
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX27089%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for YX27089: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: XV30481
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: HA24059
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MJ37367
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: HA49893
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: FK89155
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK89155%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for FK89155: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: AJ71510
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ71510%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for AJ71510: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: VB16159
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB16159%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for VB16159: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: BH25035
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH25035%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for BH25035: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: RC86938
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MH67906
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH67906%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for MH67906: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: CT16450
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT16450%27 HTTP/1.1" 200 None
2026-03-30 12:30:19 [auto1.it] INFO: Scrape type for CT16450: 0
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: MB21840
2026-03-30 12:30:19 [auto1.it] INFO: Found listing with ID: BZ38599
2026-03-30 12:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:23 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: BZ19379
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ19379%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for BZ19379: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: GR20661
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR20661%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for GR20661: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: LL47627
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: MX71384
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX71384%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for MX71384: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: JF46642
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF46642%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for JF46642: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: CZ45598
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ45598%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for CZ45598: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: GZ96497
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ96497%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for GZ96497: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: MA97320
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: SU50076
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU50076%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for SU50076: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: KK34304
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK34304%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for KK34304: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: UX20076
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: PM97583
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: KA09698
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: XM71066
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71066%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for XM71066: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: BF97905
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF97905%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for BF97905: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: BU32939
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: ZF50990
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: NY67397
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: YV30148
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: VM52207
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: GR99971
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR99971%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for GR99971: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: ZZ58047
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: UT61687
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT61687%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for UT61687: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: PZ68086
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ68086%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for PZ68086: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: ZY19539
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: ZH83607
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: DM89390
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: GW68034
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW68034%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for GW68034: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: BX66797
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX66797%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for BX66797: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: UL03529
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL03529%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for UL03529: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: EX36088
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX36088%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for EX36088: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: TJ83319
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ83319%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for TJ83319: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: EY09405
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: EV42289
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: KC61332
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC61332%27 HTTP/1.1" 200 None
2026-03-30 12:30:23 [auto1.it] INFO: Scrape type for KC61332: 0
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: DF99312
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: GJ96809
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: LS85229
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: AN76341
2026-03-30 12:30:23 [auto1.it] INFO: Found listing with ID: VN52677
2026-03-30 12:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:34 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: KJ50164
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KJ50164%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for KJ50164: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: YM77442
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM77442%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for YM77442: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: HG08694
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08694%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for HG08694: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: CY67116
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY67116%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for CY67116: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: CW72749
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW72749%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for CW72749: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: VZ97279
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: BL83628
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: RL69562
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: NR87302
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: VL00110
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL00110%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for VL00110: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: MA00484
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA00484%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for MA00484: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: AW89631
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: AX03147
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX03147%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for AX03147: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: SV06431
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV06431%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for SV06431: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: AG39012
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: TA27022
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: DC35918
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: TJ75613
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ75613%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for TJ75613: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: YV81257
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: CM69577
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: SC87766
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: HW75415
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW75415%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for HW75415: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: NU75825
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU75825%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for NU75825: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: KV08617
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV08617%27 HTTP/1.1" 200 None
2026-03-30 12:30:34 [auto1.it] INFO: Scrape type for KV08617: 0
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: EZ12998
2026-03-30 12:30:34 [auto1.it] INFO: Found listing with ID: NX89211
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX89211%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for NX89211: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: BV47322
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: PR82970
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: NN24552
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: DD47357
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD47357%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for DD47357: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: GE66634
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: EC84156
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84156%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for EC84156: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: MJ25258
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: WD60231
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: DX69970
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX69970%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for DX69970: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: SY68388
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: KA52665
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA52665%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for KA52665: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: HL79864
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: TM51427
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM51427%27 HTTP/1.1" 200 None
2026-03-30 12:30:35 [auto1.it] INFO: Scrape type for TM51427: 0
2026-03-30 12:30:35 [auto1.it] INFO: Found listing with ID: NT07416
2026-03-30 12:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:37 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: LY93977
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: EY61657
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY61657%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for EY61657: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: WV93749
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV93749%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for WV93749: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: NR03781
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: XX43378
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX43378%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for XX43378: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: HW21830
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: DJ29974
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ29974%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for DJ29974: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: AK22038
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: BV67922
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: KH48340
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: FJ09980
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ09980%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for FJ09980: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: BG92234
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: UA98347
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: HP60897
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP60897%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for HP60897: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: LY78924
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY78924%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for LY78924: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: PZ75115
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: GN40589
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN40589%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for GN40589: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: ET82005
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: UR67041
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: XY85045
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY85045%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for XY85045: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: ZH20956
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: HK60927
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60927%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for HK60927: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: BD18129
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: UY94009
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY94009%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for UY94009: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: PP36077
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP36077%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for PP36077: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: LE83570
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: AY28860
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY28860%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for AY28860: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: RG24184
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: KU84675
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: BW30944
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: CV26562
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for CV26562: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: YH66131
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: WU70120
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU70120%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for WU70120: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: TH98415
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH98415%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for TH98415: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: LE69865
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE69865%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for LE69865: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: AA15878
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA15878%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for AA15878: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: VF67541
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF67541%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for VF67541: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: DS14351
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS14351%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for DS14351: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: RA39852
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA39852%27 HTTP/1.1" 200 None
2026-03-30 12:30:37 [auto1.it] INFO: Scrape type for RA39852: 0
2026-03-30 12:30:37 [auto1.it] INFO: Found listing with ID: LG90075
2026-03-30 12:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:44 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: SB84815
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: RV29599
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: AP46989
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP46989%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for AP46989: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: DC14157
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC14157%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for DC14157: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: SY71538
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY71538%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for SY71538: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: TV97878
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: DY67923
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: DU03202
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU03202%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for DU03202: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: RL27846
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: JT53783
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT53783%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for JT53783: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: PK93114
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK93114%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for PK93114: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: HS60673
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: GB15509
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: YF83888
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: NM97698
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: WC79116
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC79116%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for WC79116: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: GA22711
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: KT64542
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: VJ15098
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: BP75996
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: YP88006
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP88006%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for YP88006: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: DA03444
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA03444%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for DA03444: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: ZJ84308
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ84308%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for ZJ84308: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: JX77984
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: WA94787
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: AN65635
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN65635%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for AN65635: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: ER60323
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: ZC12877
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: YT71636
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT71636%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for YT71636: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: TC55039
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: TT29802
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT29802%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for TT29802: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: WG32639
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG32639%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for WG32639: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: DT03603
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT03603%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for DT03603: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: BW92200
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: JJ00308
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ00308%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for JJ00308: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: SM78375
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM78375%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for SM78375: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: XV63353
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV63353%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for XV63353: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: AF62726
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF62726%27 HTTP/1.1" 200 None
2026-03-30 12:30:44 [auto1.it] INFO: Scrape type for AF62726: 0
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: JK19998
2026-03-30 12:30:44 [auto1.it] INFO: Found listing with ID: AA77653
2026-03-30 12:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:51 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: PC98849
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: ZH14156
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: MW39681
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW39681%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for MW39681: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: ED24082
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED24082%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for ED24082: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: CS63696
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: TK21590
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: BZ92290
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ92290%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for BZ92290: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: CY38939
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: GB25673
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: VP57623
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: RF81077
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: TB87558
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: BG63942
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: FP39081
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: JK72241
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: SV47237
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV47237%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for SV47237: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: BJ56464
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ56464%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for BJ56464: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: YM87758
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: ZZ84284
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ84284%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for ZZ84284: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: DT80925
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT80925%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for DT80925: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: JE22248
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: TK52144
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK52144%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for TK52144: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: WN04356
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: MV72435
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV72435%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for MV72435: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: DN06430
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: DB48039
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DB48039%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for DB48039: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: PG30215
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: HJ29626
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ29626%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for HJ29626: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: LE34139
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: WA17168
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA17168%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for WA17168: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: NW33214
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: KM60643
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: HM75417
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM75417%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for HM75417: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: YJ19643
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: FA14531
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: UK81128
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: NP73440
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: EX63117
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX63117%27 HTTP/1.1" 200 None
2026-03-30 12:30:51 [auto1.it] INFO: Scrape type for EX63117: 0
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: XY01998
2026-03-30 12:30:51 [auto1.it] INFO: Found listing with ID: PU31383
2026-03-30 12:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:52 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: VW55609
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: GT29075
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT29075%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for GT29075: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: GU77737
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU77737%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for GU77737: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: HB16965
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: MR77890
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR77890%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for MR77890: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: YV05743
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: PF34434
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: WC74031
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: JX88072
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX88072%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for JX88072: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: RX56981
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX56981%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for RX56981: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: GK78274
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: NB92665
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB92665%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for NB92665: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: CR61657
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: RU81882
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU81882%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for RU81882: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: NR76329
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: BY77891
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: FT91483
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: WK11111
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK11111%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for WK11111: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: HL96914
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL96914%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for HL96914: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: UZ59848
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: MU02206
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU02206%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for MU02206: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: UW33297
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW33297%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for UW33297: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: LH51600
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH51600%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for LH51600: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: CW23550
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW23550%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for CW23550: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: VL28200
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: DZ80898
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: PK60217
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: YV65594
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV65594%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for YV65594: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: UV62618
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: ME67142
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME67142%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for ME67142: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: EH68061
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH68061%27 HTTP/1.1" 200 None
2026-03-30 12:30:52 [auto1.it] INFO: Scrape type for EH68061: 0
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: MP71804
2026-03-30 12:30:52 [auto1.it] INFO: Found listing with ID: HG08140
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG08140%27 HTTP/1.1" 200 None
2026-03-30 12:30:53 [auto1.it] INFO: Scrape type for HG08140: 0
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: UL24997
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: EC56092
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: DF56056
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: BA50531
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA50531%27 HTTP/1.1" 200 None
2026-03-30 12:30:53 [auto1.it] INFO: Scrape type for BA50531: 0
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: PV65475
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: RG96871
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG96871%27 HTTP/1.1" 200 None
2026-03-30 12:30:53 [auto1.it] INFO: Scrape type for RG96871: 0
2026-03-30 12:30:53 [auto1.it] INFO: Found listing with ID: SJ73545
2026-03-30 12:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:30:55 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 3592 | hits on page: 40
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: BF99342
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF99342%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for BF99342: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: FU33041
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU33041%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for FU33041: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: WR25363
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR25363%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for WR25363: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: NY98259
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY98259%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for NY98259: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: XE78625
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78625%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for XE78625: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: AU72091
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: RA61931
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA61931%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for RA61931: 0
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: UZ37395
2026-03-30 12:30:55 [auto1.it] INFO: Found listing with ID: FT31182
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT31182%27 HTTP/1.1" 200 None
2026-03-30 12:30:55 [auto1.it] INFO: Scrape type for FT31182: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: ET06239
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: MF53034
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: SV79819
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV79819%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for SV79819: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: LB26900
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: PS84479
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for PS84479: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: AK50840
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK50840%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for AK50840: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: GY48890
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: FR18393
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR18393%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for FR18393: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: AV53481
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: PF95783
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: AB57400
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB57400%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for AB57400: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: GJ41533
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: VX65874
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX65874%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for VX65874: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: KC78706
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC78706%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for KC78706: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: EU94181
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU94181%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for EU94181: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: AL96330
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: CX70522
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: BJ67581
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ67581%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for BJ67581: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: RN93859
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN93859%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for RN93859: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: MG94028
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG94028%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for MG94028: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: ET76297
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: KC92917
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: LT09174
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT09174%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for LT09174: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: JK70304
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: TT78909
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT78909%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for TT78909: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: EH72083
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: YW20970
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: XH54291
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: MT29118
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: DU49636
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU49636%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for DU49636: 0
2026-03-30 12:30:56 [auto1.it] INFO: Found listing with ID: GE97185
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GE97185%27 HTTP/1.1" 200 None
2026-03-30 12:30:56 [auto1.it] INFO: Scrape type for GE97185: 0
2026-03-30 12:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:04 [scrapy.extensions.logstats] INFO: Crawled 244 pages (at 8 pages/min), scraped 135 items (at 0 items/min)
2026-03-30 12:31:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:17 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: TS11869
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: UJ50466
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ50466%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for UJ50466: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: CM44345
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: DT89224
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: BT02963
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT02963%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for BT02963: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: RZ83260
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ83260%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for RZ83260: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: TV98220
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV98220%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for TV98220: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: JT03788
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: PZ95103
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ95103%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for PZ95103: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: AT36089
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: XU47833
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU47833%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for XU47833: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: SR34135
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR34135%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for SR34135: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: MH60635
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH60635%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for MH60635: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: VB43526
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: ZU21710
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU21710%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for ZU21710: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: VU35787
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU35787%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for VU35787: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: JE99705
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: FF41288
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: ST04114
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: MX17045
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: VR64645
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR64645%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for VR64645: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: SN43822
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN43822%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for SN43822: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: RA13201
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: SD56970
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD56970%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for SD56970: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: CW79165
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: VT45573
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT45573%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for VT45573: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: DN35896
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: LJ66160
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ66160%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for LJ66160: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: ZN78264
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN78264%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for ZN78264: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: SH22668
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22668%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for SH22668: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: YA14449
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: NV42122
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: JZ43630
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43630%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for JZ43630: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: AG55709
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: TT43912
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for TT43912: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: UZ37756
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ37756%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for UZ37756: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: RW18979
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW18979%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for RW18979: 0
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: UT39332
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: NF11774
2026-03-30 12:31:17 [auto1.it] INFO: Found listing with ID: HH94865
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH94865%27 HTTP/1.1" 200 None
2026-03-30 12:31:17 [auto1.it] INFO: Scrape type for HH94865: 0
2026-03-30 12:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:19 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: GV68046
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: AM83523
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: PL36367
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PL36367%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for PL36367: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: FD72326
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: EZ36845
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ36845%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for EZ36845: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: ES96291
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: DJ07683
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: ZU40989
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU40989%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for ZU40989: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: DM38646
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM38646%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for DM38646: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: YA96352
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: NJ11800
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: EA59370
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA59370%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for EA59370: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: MD00417
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: LE83357
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: NK45302
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: ZC32771
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: DX48884
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: GJ25727
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: EM71095
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM71095%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for EM71095: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: BU87588
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU87588%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for BU87588: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: CS73145
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS73145%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for CS73145: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: PF00609
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PF00609%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for PF00609: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: VJ94912
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: MU64340
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for MU64340: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: TU34163
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: ZV32235
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: LA78712
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA78712%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for LA78712: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: TZ72536
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: UU36082
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU36082%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for UU36082: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: UF95553
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: VB04552
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for VB04552: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: AR75288
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for AR75288: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: NV53187
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: LV27017
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: PW45536
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: CV60051
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: DX65690
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: LD05493
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD05493%27 HTTP/1.1" 200 None
2026-03-30 12:31:19 [auto1.it] INFO: Scrape type for LD05493: 0
2026-03-30 12:31:19 [auto1.it] INFO: Found listing with ID: RN24419
2026-03-30 12:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-03-30 12:31:20 [auto1.it] INFO: Scrape type for RN24419: 0
2026-03-30 12:31:20 [auto1.it] INFO: Found listing with ID: MP43347
2026-03-30 12:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP43347%27 HTTP/1.1" 200 None
2026-03-30 12:31:20 [auto1.it] INFO: Scrape type for MP43347: 0
2026-03-30 12:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:41 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: GM98091
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: FZ84197
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ84197%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for FZ84197: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: DD33299
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD33299%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for DD33299: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: YL53737
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: TH12767
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for TH12767: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: YY06074
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: BT07540
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: GU21322
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: RF01908
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF01908%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for RF01908: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: TD67992
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: AT20318
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: VD89462
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: MT35916
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: BN48518
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: NV82845
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: AL33371
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: CT54414
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: BP08183
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP08183%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for BP08183: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: HP00544
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP00544%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for HP00544: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: BN63914
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: BP79618
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: HF95426
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF95426%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for HF95426: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: JM07675
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM07675%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for JM07675: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: RH51266
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: WX96902
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: PY07878
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY07878%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for PY07878: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: KZ05620
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: NU85167
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: YG23649
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: ML72062
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML72062%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for ML72062: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: VC28082
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: ZP66852
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP66852%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for ZP66852: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: EC11217
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: WT09600
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: VK05865
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK05865%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for VK05865: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: NB08226
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB08226%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for NB08226: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: MA64070
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: LD57265
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for LD57265: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: SU00968
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU00968%27 HTTP/1.1" 200 None
2026-03-30 12:31:41 [auto1.it] INFO: Scrape type for SU00968: 0
2026-03-30 12:31:41 [auto1.it] INFO: Found listing with ID: LC40122
2026-03-30 12:31:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:43 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: SV45287
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV45287%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for SV45287: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: AY64399
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY64399%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for AY64399: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: YH31345
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH31345%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for YH31345: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: WR22265
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: RL06920
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: YT62048
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT62048%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for YT62048: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: YL77268
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL77268%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for YL77268: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: EF61328
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: JK32872
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK32872%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for JK32872: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: FU79114
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: NJ78354
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ78354%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for NJ78354: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: TZ83605
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for TZ83605: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: DD73045
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD73045%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for DD73045: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: JL50472
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: EA68503
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for EA68503: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: JJ73686
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: CC19770
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC19770%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for CC19770: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: JS86571
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS86571%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for JS86571: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: UZ46554
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: PM10706
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10706%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for PM10706: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: CB30744
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: MY09959
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY09959%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for MY09959: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: ML86144
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: JM74615
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM74615%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for JM74615: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: ZU26854
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: HK60506
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK60506%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for HK60506: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: DR95248
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: UK81379
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK81379%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for UK81379: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: DW65816
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: BX49691
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX49691%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for BX49691: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: AL00602
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: MX95744
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: KC58138
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for KC58138: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: DP76328
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: UY83511
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: HM97674
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for HM97674: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: DF59331
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF59331%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for DF59331: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: MR40406
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR40406%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for MR40406: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: KP16451
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP16451%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for KP16451: 0
2026-03-30 12:31:43 [auto1.it] INFO: Found listing with ID: BX11314
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX11314%27 HTTP/1.1" 200 None
2026-03-30 12:31:43 [auto1.it] INFO: Scrape type for BX11314: 0
2026-03-30 12:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:52 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: XR19887
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for XR19887: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: JZ39211
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ39211%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for JZ39211: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: EG37801
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: HF76476
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF76476%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for HF76476: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: AK59444
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: BK23225
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: TU23775
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU23775%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for TU23775: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: ST52943
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST52943%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for ST52943: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: AB43384
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: XF42049
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: CM37896
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: NP19925
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: KU20000
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: VZ89804
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ89804%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for VZ89804: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: BS34699
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: AS57750
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS57750%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for AS57750: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: PW94322
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94322%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for PW94322: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: FU65166
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU65166%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for FU65166: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: LG94393
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG94393%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for LG94393: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: AB09853
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB09853%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for AB09853: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: BL94999
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: PE73293
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: LW03785
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW03785%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for LW03785: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: UP48367
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for UP48367: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: LW86273
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86273%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for LW86273: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: LY27741
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: YA33323
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA33323%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for YA33323: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: TR04058
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: NC94766
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for NC94766: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: UC76692
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: NT59940
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: KM64603
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM64603%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for KM64603: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: PA30121
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA30121%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for PA30121: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: ZY33580
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY33580%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for ZY33580: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: YJ83729
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ83729%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for YJ83729: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: WL70343
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-30 12:31:52 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-30 12:31:52 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-30 12:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:54 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: RA56260
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA56260%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for RA56260: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: EK01014
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK01014%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for EK01014: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: ZH89782
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH89782%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for ZH89782: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: YS46644
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46644%27 HTTP/1.1" 200 None
2026-03-30 12:31:54 [auto1.it] INFO: Scrape type for YS46644: 0
2026-03-30 12:31:54 [auto1.it] INFO: Found listing with ID: RC57618
2026-03-30 12:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC57618%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for RC57618: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: RZ13611
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ13611%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for RZ13611: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: TD94995
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: EW86248
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW86248%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for EW86248: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: WB67715
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB67715%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for WB67715: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: ZK23412
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: KT97112
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: VX54409
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54409%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for VX54409: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: XH11814
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH11814%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for XH11814: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: KN64287
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN64287%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for KN64287: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: JM92552
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: HP20595
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: RF53509
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53509%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for RF53509: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: VY56093
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: XS81991
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: KL09391
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: DH11119
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: VL58331
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: MW24611
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: WJ42513
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ42513%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for WJ42513: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: RX80413
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX80413%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for RX80413: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: JK04484
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: ZE02722
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02722%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for ZE02722: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: PA82276
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA82276%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for PA82276: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: XE77432
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE77432%27 HTTP/1.1" 200 None
2026-03-30 12:31:55 [auto1.it] INFO: Scrape type for XE77432: 0
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: BG27865
2026-03-30 12:31:55 [auto1.it] INFO: Found listing with ID: EK32086
2026-03-30 12:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:31:57 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 3591 | hits on page: 40
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: VN61969
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN61969%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for VN61969: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: RH32617
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH32617%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for RH32617: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: TJ05076
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: PZ73460
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ73460%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for PZ73460: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: TY12720
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: RS94831
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: BZ50824
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ50824%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for BZ50824: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: TW69168
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: XK06732
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: CE45515
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE45515%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for CE45515: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: SY67891
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: WE05863
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: KR29976
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: ES96782
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: PU50365
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU50365%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for PU50365: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: NP45555
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP45555%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for NP45555: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE11885%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for LE11885: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: EW80133
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW80133%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for EW80133: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: DB86833
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: VF83639
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF83639%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for VF83639: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: AC12689
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: KK08991
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK08991%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for KK08991: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: NJ15500
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: LA80285
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM41534%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for LM41534: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: UK25874
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK25874%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for UK25874: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for LV20949: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: US42109
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46190%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for YD46190: 0
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-30 12:31:57 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-30 12:31:57 [auto1.it] INFO: Scrape type for WV37243: 2
2026-03-30 12:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-30 12:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36cd066-49a8-5825-922e-e3e60f34fdbe with scrape type 2
2026-03-30 12:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f36cd066-49a8-5825-922e-e3e60f34fdbe with scrape type 2
2026-03-30 12:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f36cd066-49a8-5825-922e-e3e60f34fdbe, identifier: WV37243
2026-03-30 12:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-30 12:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243
2026-03-30 12:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f36cd066-49a8-5825-922e-e3e60f34fdbe with identifier: WV37243 to the API
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:00:50Z',
'fuel_type': 'diesel',
'id': 'f36cd066-49a8-5825-922e-e3e60f34fdbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV37243',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 164559,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-26',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2018}
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-30 12:31:58 [auto1.it] INFO: Saving data for WV37243: {'auction_closing_time': 1774882850.0, 'created_time': 1772568047.063719, 'last_price_update_time': 1774873918.478434}
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV37243') HTTP/1.1" 204 0
2026-03-30 12:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:31:58 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-30 12:31:58 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-30 12:32:04 [scrapy.extensions.logstats] INFO: Crawled 251 pages (at 7 pages/min), scraped 136 items (at 1 items/min)
2026-03-30 12:32:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:06 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 3591 | hits on page: 40
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: JV01871
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43313%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for WK43313: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV07226%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for UV07226: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC45028%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for DC45028: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD73790%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for BD73790: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL28261%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for SL28261: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH70338%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for PH70338: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for YD99116: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC79515%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for XC79515: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for RS77350: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET21203%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for ET21203: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ70208%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for HZ70208: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG99585%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for BG99585: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for JP32854: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for FV19054: 0
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-30 12:32:06 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-30 12:32:06 [auto1.it] INFO: Scrape type for KC73163: 2
2026-03-30 12:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-30 12:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 2
2026-03-30 12:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 2
2026-03-30 12:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd, identifier: KC73163
2026-03-30 12:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-30 12:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-03-30 12:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163 to the API
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:18Z',
'fuel_type': 'diesel',
'id': '0b2ea67f-529f-589e-9934-ca76b4f4b9dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC73163',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 181099,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-09',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 2.0 JTDM Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2013}
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Saving data for KC73163: {'auction_closing_time': 1774885578.0, 'created_time': 1774602437.765037, 'last_price_update_time': 1774873927.260861}
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KC73163') HTTP/1.1" 204 0
2026-03-30 12:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA54300%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for YA54300: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ66117%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for UJ66117: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE99850%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for RE99850: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for CU15371: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for JP92326: 2
2026-03-30 12:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-30 12:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with scrape type 2
2026-03-30 12:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with scrape type 2
2026-03-30 12:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89, identifier: JP92326
2026-03-30 12:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-30 12:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326
2026-03-30 12:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e18bb4a-3e30-5a32-afe8-0f88da5b7f89 with identifier: JP92326 to the API
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:56:38Z',
'fuel_type': 'diesel',
'id': '4e18bb4a-3e30-5a32-afe8-0f88da5b7f89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP92326',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 212819,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-28',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Saving data for JP92326: {'auction_closing_time': 1774886198.0, 'created_time': 1774602388.45518, 'last_price_update_time': 1774873927.817024}
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP92326') HTTP/1.1" 204 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB01371%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for AB01371: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59296%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for TU59296: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for RM66107: 0
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-30 12:32:07 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-30 12:32:07 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-30 12:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:26 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for XD81326: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74969%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for LK74969: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for PW94940: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for UH56050: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06455%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for XT06455: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF91623%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for LF91623: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE55630%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for WE55630: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for DD62614: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV99150%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for LV99150: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC44140%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for VC44140: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for SG91000: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for AA32249: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for YV19719: 0
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-30 12:32:26 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-30 12:32:26 [auto1.it] INFO: Scrape type for ZZ46834: 2
2026-03-30 12:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-30 12:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96181f94-5de2-5872-9b3a-925dfea00be1 with scrape type 2
2026-03-30 12:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96181f94-5de2-5872-9b3a-925dfea00be1 with scrape type 2
2026-03-30 12:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 96181f94-5de2-5872-9b3a-925dfea00be1, identifier: ZZ46834
2026-03-30 12:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-30 12:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834
2026-03-30 12:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 96181f94-5de2-5872-9b3a-925dfea00be1 with identifier: ZZ46834 to the API
2026-03-30 12:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:55:53Z',
'fuel_type': 'diesel',
'id': '96181f94-5de2-5872-9b3a-925dfea00be1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ46834',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 112251,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-27',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Cross',
'transmission': 'manual',
'trim': 'Cross',
'year': 2018}
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Saving data for ZZ46834: {'auction_closing_time': 1774886153.0, 'created_time': 1773136060.73377, 'last_price_update_time': 1774873947.168072}
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ46834') HTTP/1.1" 204 0
2026-03-30 12:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Scrape type for EV65529: 0
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW82008%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Scrape type for YW82008: 0
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH72386%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Scrape type for MH72386: 0
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX56381%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Scrape type for CX56381: 0
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-30 12:32:27 [auto1.it] INFO: Scrape type for FB75949: 0
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-30 12:32:27 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-30 12:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:29 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for UK70353: 0
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for LC51604: 0
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: AU35917
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU35917%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for AU35917: 0
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for LC01017: 0
2026-03-30 12:32:29 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Scrape type for XH41983: 2
2026-03-30 12:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-30 12:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34177cd2-f993-58b9-a77d-fd8e6f163141 with scrape type 2
2026-03-30 12:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34177cd2-f993-58b9-a77d-fd8e6f163141 with scrape type 2
2026-03-30 12:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34177cd2-f993-58b9-a77d-fd8e6f163141, identifier: XH41983
2026-03-30 12:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-30 12:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983
2026-03-30 12:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34177cd2-f993-58b9-a77d-fd8e6f163141 with identifier: XH41983 to the API
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:23:57Z',
'fuel_type': 'diesel',
'id': '34177cd2-f993-58b9-a77d-fd8e6f163141',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41983',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 290306,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-31',
'seller_name': None,
'title': 'Ford Grand C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-30 12:32:29 [auto1.it] INFO: Saving data for XH41983: {'auction_closing_time': 1774884237.0, 'created_time': 1774602429.633157, 'last_price_update_time': 1774873949.934817}
2026-03-30 12:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH41983') HTTP/1.1" 204 0
2026-03-30 12:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for MW60739: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for RR03246: 2
2026-03-30 12:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-30 12:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d67696-6bb3-5230-acad-0bc1c92390cf with scrape type 2
2026-03-30 12:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44d67696-6bb3-5230-acad-0bc1c92390cf with scrape type 2
2026-03-30 12:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 44d67696-6bb3-5230-acad-0bc1c92390cf, identifier: RR03246
2026-03-30 12:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-30 12:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246
2026-03-30 12:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 44d67696-6bb3-5230-acad-0bc1c92390cf with identifier: RR03246 to the API
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:01:12Z',
'fuel_type': 'diesel',
'id': '44d67696-6bb3-5230-acad-0bc1c92390cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR03246',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 256662,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-01',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Saving data for RR03246: {'auction_closing_time': 1774882872.0, 'created_time': 1773132025.673629, 'last_price_update_time': 1774873950.56438}
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR03246') HTTP/1.1" 204 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for HY79670: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC99785%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for EC99785: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for MB50671: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL94615%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for LL94615: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC03945%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for DC03945: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML20734%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for ML20734: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ22961%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for CZ22961: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC19416%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for ZC19416: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA77848%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for MA77848: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF61926%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for CF61926: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD82423%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for HD82423: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for AY21125: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW60366%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for NW60366: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV42889%27 HTTP/1.1" 200 None
2026-03-30 12:32:30 [auto1.it] INFO: Scrape type for WV42889: 0
2026-03-30 12:32:30 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-30 12:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:31 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ48642%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for EZ48642: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL86512%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for SL86512: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for DN82434: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP35914%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for FP35914: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for EC84941: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for JJ80566: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL33082%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for RL33082: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS43685%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for KS43685: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX88611%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for WX88611: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for FA16942: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for JF75950: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY64752%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for RY64752: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-30 12:32:31 [auto1.it] INFO: Scrape type for CH57446: 0
2026-03-30 12:32:31 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-30 12:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for KB12646: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC67394%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for NC67394: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM00919%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for WM00919: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ91749%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for XJ91749: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for UR83709: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for JB13262: 2
2026-03-30 12:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-30 12:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c02b8b-9544-544c-a433-1519d8b819e6 with scrape type 2
2026-03-30 12:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c02b8b-9544-544c-a433-1519d8b819e6 with scrape type 2
2026-03-30 12:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54c02b8b-9544-544c-a433-1519d8b819e6, identifier: JB13262
2026-03-30 12:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-30 12:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262
2026-03-30 12:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54c02b8b-9544-544c-a433-1519d8b819e6 with identifier: JB13262 to the API
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:23Z',
'fuel_type': 'petrol',
'id': '54c02b8b-9544-544c-a433-1519d8b819e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB13262',
'listing': 'auction',
'make': 'Lancia',
'model': 'Delta',
'odometer': 142599,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-27',
'seller_name': None,
'title': 'Lancia Delta 1.4 Turbo Oro',
'transmission': 'manual',
'trim': 'Oro',
'year': 2009}
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Saving data for JB13262: {'auction_closing_time': 1774884683.0, 'created_time': 1774602432.108561, 'last_price_update_time': 1774873952.571399}
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JB13262') HTTP/1.1" 204 0
2026-03-30 12:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for AR28136: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: TU38446
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU38446%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for TU38446: 0
2026-03-30 12:32:32 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-30 12:32:32 [auto1.it] INFO: Scrape type for EV19228: 2
2026-03-30 12:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-30 12:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with scrape type 2
2026-03-30 12:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with scrape type 2
2026-03-30 12:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad, identifier: EV19228
2026-03-30 12:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-30 12:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228
2026-03-30 12:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fbc3ba1a-3c99-55da-a6f5-35f88dc683ad with identifier: EV19228 to the API
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:25:26Z',
'fuel_type': 'petrol',
'id': 'fbc3ba1a-3c99-55da-a6f5-35f88dc683ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV19228',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 16306,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seller_name': None,
'title': 'MINI John Cooper Works',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-30 12:32:33 [auto1.it] INFO: Saving data for EV19228: {'auction_closing_time': 1774884326.0, 'created_time': 1772779429.759289, 'last_price_update_time': 1774873953.348786}
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV19228') HTTP/1.1" 204 0
2026-03-30 12:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:34 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH45262%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for EH45262: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: BV63915
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV63915%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for BV63915: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU83939%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for JU83939: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT94062%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for FT94062: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for LX11958: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA53057%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for PA53057: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12322%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for DW12322: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86126%27 HTTP/1.1" 200 None
2026-03-30 12:32:34 [auto1.it] INFO: Scrape type for GM86126: 0
2026-03-30 12:32:34 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-30 12:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for GF15997: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL22636%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for AL22636: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF61265%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for MF61265: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: ZX69560
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX69560%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for ZX69560: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG89993%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for EG89993: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for CB33793: 0
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-30 12:32:35 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Scrape type for MH68095: 2
2026-03-30 12:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-30 12:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with scrape type 2
2026-03-30 12:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with scrape type 2
2026-03-30 12:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5, identifier: MH68095
2026-03-30 12:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-30 12:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095
2026-03-30 12:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a487bf4a-01f9-51ef-b70e-2f3e5195c2d5 with identifier: MH68095 to the API
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:01:43Z',
'fuel_type': 'diesel',
'id': 'a487bf4a-01f9-51ef-b70e-2f3e5195c2d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH68095',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 261687,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-21',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2011}
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-30 12:32:35 [auto1.it] INFO: Saving data for MH68095: {'auction_closing_time': 1774882903.0, 'created_time': 1774274738.416709, 'last_price_update_time': 1774873955.499161}
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MH68095') HTTP/1.1" 204 0
2026-03-30 12:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:36 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for HC25835: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD83320%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for RD83320: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD20323%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for KD20323: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for KT78402: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ23741%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for TZ23741: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: XT36875
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT36875%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for XT36875: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC12493%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for NC12493: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT65910%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for BT65910: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP73975%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for ZP73975: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY77506%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for AY77506: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for ED22447: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ49625%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ63395%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for PZ63395: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for TY62021: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW24266%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for CW24266: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR49145%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for BR49145: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT62115%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for CT62115: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND06570%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for ND06570: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX03621%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for FX03621: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS09351%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for SS09351: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for PW70389: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ97902%27 HTTP/1.1" 200 None
2026-03-30 12:32:36 [auto1.it] INFO: Scrape type for MJ97902: 0
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-30 12:32:36 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-30 12:32:37 [auto1.it] INFO: Scrape type for BR31613: 0
2026-03-30 12:32:37 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU78491%27 HTTP/1.1" 200 None
2026-03-30 12:32:37 [auto1.it] INFO: Scrape type for AU78491: 0
2026-03-30 12:32:37 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-30 12:32:37 [auto1.it] INFO: Scrape type for FX08227: 0
2026-03-30 12:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:44 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:44 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-30 12:32:44 [auto1.it] INFO: Scrape type for FH51436: 0
2026-03-30 12:32:44 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-30 12:32:44 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY63215%27 HTTP/1.1" 200 None
2026-03-30 12:32:44 [auto1.it] INFO: Scrape type for ZY63215: 0
2026-03-30 12:32:44 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-30 12:32:44 [auto1.it] INFO: Scrape type for TH24600: 2
2026-03-30 12:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-30 12:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca9ca275-baad-5b60-ad8a-dafe4b1895af with scrape type 2
2026-03-30 12:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca9ca275-baad-5b60-ad8a-dafe4b1895af with scrape type 2
2026-03-30 12:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ca9ca275-baad-5b60-ad8a-dafe4b1895af, identifier: TH24600
2026-03-30 12:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-30 12:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600
2026-03-30 12:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ca9ca275-baad-5b60-ad8a-dafe4b1895af with identifier: TH24600 to the API
2026-03-30 12:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:34:15Z',
'fuel_type': 'diesel',
'id': 'ca9ca275-baad-5b60-ad8a-dafe4b1895af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH24600',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 260831,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Saving data for TH24600: {'auction_closing_time': 1774884855.0, 'created_time': 1772308886.418147, 'last_price_update_time': 1774873965.124524}
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH24600') HTTP/1.1" 204 0
2026-03-30 12:32:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for UD54750: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76824%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for SP76824: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK41226%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for LK41226: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK49323%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for SK49323: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG84271%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for YG84271: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW53696%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for DW53696: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for HG71843: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD82932%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for DD82932: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK85417%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for FK85417: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN99841%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for RN99841: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP55584%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for CP55584: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK72900%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for GK72900: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for JR96571: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN45534%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for XN45534: 0
2026-03-30 12:32:45 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Scrape type for EC13131: 2
2026-03-30 12:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-30 12:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd94b4e5-1d05-50bb-baf6-842a238367e5 with scrape type 2
2026-03-30 12:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd94b4e5-1d05-50bb-baf6-842a238367e5 with scrape type 2
2026-03-30 12:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd94b4e5-1d05-50bb-baf6-842a238367e5, identifier: EC13131
2026-03-30 12:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-30 12:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131
2026-03-30 12:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd94b4e5-1d05-50bb-baf6-842a238367e5 with identifier: EC13131 to the API
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:13:04Z',
'fuel_type': 'petrol',
'id': 'fd94b4e5-1d05-50bb-baf6-842a238367e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC13131',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 11503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-18',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-30 12:32:45 [auto1.it] INFO: Saving data for EC13131: {'auction_closing_time': 1774883584.0, 'created_time': 1773136205.833878, 'last_price_update_time': 1774873965.891517}
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC13131') HTTP/1.1" 204 0
2026-03-30 12:32:46 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS14469%27 HTTP/1.1" 200 None
2026-03-30 12:32:46 [auto1.it] INFO: Scrape type for CS14469: 0
2026-03-30 12:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:32:54 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 3592 | hits on page: 40
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR70375%27 HTTP/1.1" 200 None
2026-03-30 12:32:54 [auto1.it] INFO: Scrape type for VR70375: 0
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD99197%27 HTTP/1.1" 200 None
2026-03-30 12:32:54 [auto1.it] INFO: Scrape type for BD99197: 0
2026-03-30 12:32:54 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-30 12:32:54 [auto1.it] INFO: Scrape type for EN53386: 2
2026-03-30 12:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-30 12:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f01568-8747-5387-998b-e62d0c10c17e with scrape type 2
2026-03-30 12:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f01568-8747-5387-998b-e62d0c10c17e with scrape type 2
2026-03-30 12:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26f01568-8747-5387-998b-e62d0c10c17e, identifier: EN53386
2026-03-30 12:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 12:32:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386
2026-03-30 12:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26f01568-8747-5387-998b-e62d0c10c17e with identifier: EN53386 to the API
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:03:24Z',
'fuel_type': 'diesel',
'id': '26f01568-8747-5387-998b-e62d0c10c17e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN53386',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 115568,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-21',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2015}
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-30 12:32:54 [auto1.it] INFO: Saving data for EN53386: {'auction_closing_time': 1774883004.0, 'created_time': 1772532113.089021, 'last_price_update_time': 1774873974.990839}
2026-03-30 12:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN53386') HTTP/1.1" 204 0
2026-03-30 12:32:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: LX30829
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for TJ19111: 2
2026-03-30 12:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-30 12:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with scrape type 2
2026-03-30 12:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with scrape type 2
2026-03-30 12:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c, identifier: TJ19111
2026-03-30 12:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-30 12:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111
2026-03-30 12:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c with identifier: TJ19111 to the API
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:33:16Z',
'fuel_type': 'petrol',
'id': 'ff91f9a2-e9d4-59b4-b92d-f23f7f3b909c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ19111',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 54889,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-29',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Saving data for TJ19111: {'auction_closing_time': 1774884796.0, 'created_time': 1774602388.992329, 'last_price_update_time': 1774873975.406237}
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ19111') HTTP/1.1" 204 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW42527%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for EW42527: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX10481%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for KX10481: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for GB22303: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for VU11306: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for JD40027: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for TY97368: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF78303%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for KF78303: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK90576%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for SK90576: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for AT74871: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for WW70884: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP22884%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for FP22884: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for FH04610: 0
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-30 12:32:55 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG60202%27 HTTP/1.1" 200 None
2026-03-30 12:32:55 [auto1.it] INFO: Scrape type for TG60202: 0
2026-03-30 12:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:03 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX50484%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.it] INFO: Scrape type for TX50484: 0
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69305%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.it] INFO: Scrape type for PG69305: 0
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-30 12:33:03 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-30 12:33:03 [auto1.it] INFO: Scrape type for JS62412: 2
2026-03-30 12:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-30 12:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3a2ca1-1a90-5f26-96ce-77dc766ec30d with scrape type 2
2026-03-30 12:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de3a2ca1-1a90-5f26-96ce-77dc766ec30d with scrape type 2
2026-03-30 12:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de3a2ca1-1a90-5f26-96ce-77dc766ec30d, identifier: JS62412
2026-03-30 12:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-30 12:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412
2026-03-30 12:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de3a2ca1-1a90-5f26-96ce-77dc766ec30d with identifier: JS62412 to the API
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:07Z',
'fuel_type': 'diesel',
'id': 'de3a2ca1-1a90-5f26-96ce-77dc766ec30d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS62412',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 75485,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-10',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Cool 2WD',
'transmission': 'manual',
'trim': 'Cool 2WD',
'year': 2014}
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Saving data for JS62412: {'auction_closing_time': 1774883467.0, 'created_time': 1774602434.849187, 'last_price_update_time': 1774873984.216866}
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JS62412') HTTP/1.1" 204 0
2026-03-30 12:33:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for WX67440: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for SE55523: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV31826%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for CV31826: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: NW47878
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW47878%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for NW47878: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for XY34648: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: PG99334
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01763%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for HS01763: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB32662%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for KB32662: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for GX95672: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT43083%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for FT43083: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for GD67829: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH53431%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for MH53431: 0
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-30 12:33:04 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Scrape type for HZ95408: 2
2026-03-30 12:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-30 12:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6042fe-d933-5d26-ac1a-04138888742a with scrape type 2
2026-03-30 12:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6042fe-d933-5d26-ac1a-04138888742a with scrape type 2
2026-03-30 12:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb6042fe-d933-5d26-ac1a-04138888742a, identifier: HZ95408
2026-03-30 12:33:04 [scrapy.extensions.logstats] INFO: Crawled 260 pages (at 9 pages/min), scraped 149 items (at 13 items/min)
2026-03-30 12:33:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-30 12:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-03-30 12:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408 to the API
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:34:43Z',
'fuel_type': 'diesel',
'id': 'bb6042fe-d933-5d26-ac1a-04138888742a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ95408',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 146510,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi L1 Sport',
'transmission': 'automatic',
'trim': 'L1 Sport',
'year': 2022}
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-30 12:33:04 [auto1.it] INFO: Saving data for HZ95408: {'auction_closing_time': 1774884883.0, 'created_time': 1774602435.708658, 'last_price_update_time': 1774873984.955804}
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ95408') HTTP/1.1" 204 0
2026-03-30 12:33:05 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-30 12:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:06 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT44801%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for TT44801: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for CU49337: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA39078%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for GA39078: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ16799%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for KZ16799: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF24893%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for HF24893: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for SR16589: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for NL55256: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ10631%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for FZ10631: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW87652%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for JW87652: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for XD70855: 2
2026-03-30 12:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-30 12:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-03-30 12:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f14374-b656-5692-abe7-824b6ba4a5ca with scrape type 2
2026-03-30 12:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97f14374-b656-5692-abe7-824b6ba4a5ca, identifier: XD70855
2026-03-30 12:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-30 12:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855
2026-03-30 12:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97f14374-b656-5692-abe7-824b6ba4a5ca with identifier: XD70855 to the API
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:51:21Z',
'fuel_type': 'diesel',
'id': '97f14374-b656-5692-abe7-824b6ba4a5ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD70855',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 113075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-19',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Premium Plus',
'transmission': 'automatic',
'trim': '4Matic Premium Plus',
'year': 2022}
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Saving data for XD70855: {'auction_closing_time': 1774885881.0, 'created_time': 1773131155.548912, 'last_price_update_time': 1774873986.845318}
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XD70855') HTTP/1.1" 204 0
2026-03-30 12:33:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV99764%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for TV99764: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18020%27 HTTP/1.1" 200 None
2026-03-30 12:33:06 [auto1.it] INFO: Scrape type for YG18020: 0
2026-03-30 12:33:06 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-30 12:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55866%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for WH55866: 0
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD54235%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for HD54235: 0
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for GT76958: 0
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for NH73732: 0
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16338%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for GT16338: 0
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-30 12:33:07 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-30 12:33:07 [auto1.it] INFO: Scrape type for FH81414: 0
2026-03-30 12:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:08 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-30 12:33:08 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS58810%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for DS58810: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE79185%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for SE79185: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17675%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for GT17675: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: HN90303
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN90303%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for HN90303: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT48153%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for JT48153: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD12623%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for PD12623: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for LG12773: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL40655%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for TL40655: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for LE96160: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for SV71044: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22715%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for HS22715: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05419%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for SC05419: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL53946%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for GL53946: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for UC13059: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB86834%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for WB86834: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF76752%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for FF76752: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for HK62879: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR79135%27 HTTP/1.1" 200 None
2026-03-30 12:33:09 [auto1.it] INFO: Scrape type for PR79135: 0
2026-03-30 12:33:09 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-30 12:33:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:45 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:45 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11641%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.it] INFO: Scrape type for XW11641: 0
2026-03-30 12:33:45 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-30 12:33:45 [auto1.it] INFO: Scrape type for LR54413: 2
2026-03-30 12:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-30 12:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acce316b-2e92-51c0-b21e-6558c1f38989 with scrape type 2
2026-03-30 12:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acce316b-2e92-51c0-b21e-6558c1f38989 with scrape type 2
2026-03-30 12:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: acce316b-2e92-51c0-b21e-6558c1f38989, identifier: LR54413
2026-03-30 12:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-30 12:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413
2026-03-30 12:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: acce316b-2e92-51c0-b21e-6558c1f38989 with identifier: LR54413 to the API
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:42:22Z',
'fuel_type': 'diesel',
'id': 'acce316b-2e92-51c0-b21e-6558c1f38989',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR54413',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 227216,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-13',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2011}
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-30 12:33:46 [auto1.it] INFO: Saving data for LR54413: {'auction_closing_time': 1774885342.0, 'created_time': 1772186486.887383, 'last_price_update_time': 1774874026.351207}
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR54413') HTTP/1.1" 204 0
2026-03-30 12:33:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31309%27 HTTP/1.1" 200 None
2026-03-30 12:33:46 [auto1.it] INFO: Scrape type for BR31309: 0
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: CD07087
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-30 12:33:46 [auto1.it] INFO: Scrape type for FF49180: 0
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS05902%27 HTTP/1.1" 200 None
2026-03-30 12:33:46 [auto1.it] INFO: Scrape type for CS05902: 0
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-30 12:33:46 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-30 12:33:46 [auto1.it] INFO: Scrape type for ZV11200: 2
2026-03-30 12:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-30 12:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 2
2026-03-30 12:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 2
2026-03-30 12:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 144334f5-960b-5ac4-8d04-293507acb064, identifier: ZV11200
2026-03-30 12:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-30 12:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-03-30 12:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200 to the API
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:51Z',
'fuel_type': 'gas',
'id': '144334f5-960b-5ac4-8d04-293507acb064',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11200',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 141853,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-04',
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe Benzin / LPG Laureate Family 4x2',
'transmission': 'manual',
'trim': 'Laureate Family 4x2',
'year': 2016}
2026-03-30 12:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Saving data for ZV11200: {'auction_closing_time': 1774883871.0, 'created_time': 1774602422.757154, 'last_price_update_time': 1774874027.006841}
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV11200') HTTP/1.1" 204 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for DA61571: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG03340%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for YG03340: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF96122%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for NF96122: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS71318%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for YS71318: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for UR23669: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN72005%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for DN72005: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for FJ79920: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK34642%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for DK34642: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for BN52557: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM00839%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for CM00839: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV74767%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for TV74767: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ91384%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for LJ91384: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for XC85106: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL90232%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for FL90232: 0
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-30 12:33:47 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-30 12:33:47 [auto1.it] INFO: Scrape type for TT97007: 0
2026-03-30 12:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:55 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP26264%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for CP26264: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74108%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for GN74108: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG54549%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for AG54549: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX44191%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for UX44191: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for BW24813: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF07503%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for JF07503: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: EM22547
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR80508%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for FR80508: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP04797%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for YP04797: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN16063%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for UN16063: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM97748%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for RM97748: 0
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-30 12:33:55 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-30 12:33:55 [auto1.it] INFO: Scrape type for LH97251: 2
2026-03-30 12:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-30 12:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630ae49b-afad-5af3-8703-54baf3133fb7 with scrape type 2
2026-03-30 12:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 630ae49b-afad-5af3-8703-54baf3133fb7 with scrape type 2
2026-03-30 12:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 630ae49b-afad-5af3-8703-54baf3133fb7, identifier: LH97251
2026-03-30 12:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-30 12:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251
2026-03-30 12:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 630ae49b-afad-5af3-8703-54baf3133fb7 with identifier: LH97251 to the API
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:47:18Z',
'fuel_type': 'petrol',
'id': '630ae49b-afad-5af3-8703-54baf3133fb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH97251',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 36716,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-12',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.0 TSI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2021}
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-30 12:33:56 [auto1.it] INFO: Saving data for LH97251: {'auction_closing_time': 1774885638.0, 'created_time': 1773132373.708529, 'last_price_update_time': 1774874036.069095}
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LH97251') HTTP/1.1" 204 0
2026-03-30 12:33:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-30 12:33:56 [auto1.it] INFO: Scrape type for RJ82738: 2
2026-03-30 12:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-30 12:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68f4c75-e018-55e2-a10a-66130601d4f0 with scrape type 2
2026-03-30 12:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a68f4c75-e018-55e2-a10a-66130601d4f0 with scrape type 2
2026-03-30 12:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a68f4c75-e018-55e2-a10a-66130601d4f0, identifier: RJ82738
2026-03-30 12:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-30 12:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738
2026-03-30 12:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a68f4c75-e018-55e2-a10a-66130601d4f0 with identifier: RJ82738 to the API
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:29:37Z',
'fuel_type': 'diesel',
'id': 'a68f4c75-e018-55e2-a10a-66130601d4f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ82738',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 151802,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-04',
'seller_name': None,
'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2018}
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-30 12:33:56 [auto1.it] INFO: Saving data for RJ82738: {'auction_closing_time': 1774884577.0, 'created_time': 1774602403.755559, 'last_price_update_time': 1774874036.558915}
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RJ82738') HTTP/1.1" 204 0
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH49254%27 HTTP/1.1" 200 None
2026-03-30 12:33:56 [auto1.it] INFO: Scrape type for KH49254: 0
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW61080%27 HTTP/1.1" 200 None
2026-03-30 12:33:56 [auto1.it] INFO: Scrape type for ZW61080: 0
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-30 12:33:56 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-30 12:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:33:57 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 3592 | hits on page: 40
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for YE38738: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for JC71555: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN44276%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for RN44276: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH59018%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for LH59018: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG00486%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for XG00486: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for UK64691: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for XW75946: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for SN49105: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for SZ00349: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH39950%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for UH39950: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM88416%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for RM88416: 0
2026-03-30 12:33:57 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-30 12:33:57 [auto1.it] INFO: Scrape type for EU38381: 2
2026-03-30 12:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-30 12:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea862d00-1370-59cd-b496-9925118b23f9 with scrape type 2
2026-03-30 12:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea862d00-1370-59cd-b496-9925118b23f9 with scrape type 2
2026-03-30 12:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea862d00-1370-59cd-b496-9925118b23f9, identifier: EU38381
2026-03-30 12:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-30 12:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381
2026-03-30 12:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea862d00-1370-59cd-b496-9925118b23f9 with identifier: EU38381 to the API
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 118,
'expiration_date': '2026-03-30T15:01:48Z',
'fuel_type': 'gas',
'id': 'ea862d00-1370-59cd-b496-9925118b23f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38381',
'listing': 'auction',
'make': 'EVO',
'model': '5',
'odometer': 58950,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-12',
'seller_name': None,
'title': 'EVO 5 1.6 LPG',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-30 12:33:58 [auto1.it] INFO: Saving data for EU38381: {'auction_closing_time': 1774882908.0, 'created_time': 1774472817.885367, 'last_price_update_time': 1774874038.263488}
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU38381') HTTP/1.1" 204 0
2026-03-30 12:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:33:58 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-30 12:33:58 [auto1.it] INFO: Scrape type for VY08024: 2
2026-03-30 12:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-30 12:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e03c9b-55b5-50cf-b946-17936586f9ad with scrape type 2
2026-03-30 12:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e03c9b-55b5-50cf-b946-17936586f9ad with scrape type 2
2026-03-30 12:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68e03c9b-55b5-50cf-b946-17936586f9ad, identifier: VY08024
2026-03-30 12:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-30 12:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024
2026-03-30 12:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68e03c9b-55b5-50cf-b946-17936586f9ad with identifier: VY08024 to the API
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:03:49Z',
'fuel_type': 'petrol',
'id': '68e03c9b-55b5-50cf-b946-17936586f9ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY08024',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 72004,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-21',
'seller_name': None,
'title': 'MINI Clubman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2020}
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-30 12:33:58 [auto1.it] INFO: Saving data for VY08024: {'auction_closing_time': 1774883029.0, 'created_time': 1773131756.75807, 'last_price_update_time': 1774874038.777938}
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY08024') HTTP/1.1" 204 0
2026-03-30 12:33:58 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-30 12:33:58 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-30 12:33:58 [auto1.it] INFO: Scrape type for AH42596: 2
2026-03-30 12:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-30 12:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3783415c-d467-5b97-a1a6-9df607b0ef62 with scrape type 2
2026-03-30 12:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3783415c-d467-5b97-a1a6-9df607b0ef62 with scrape type 2
2026-03-30 12:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3783415c-d467-5b97-a1a6-9df607b0ef62, identifier: AH42596
2026-03-30 12:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-30 12:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596
2026-03-30 12:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3783415c-d467-5b97-a1a6-9df607b0ef62 with identifier: AH42596 to the API
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:01:03Z',
'fuel_type': 'petrol',
'id': '3783415c-d467-5b97-a1a6-9df607b0ef62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH42596',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 135647,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-27',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Saving data for AH42596: {'auction_closing_time': 1774882863.0, 'created_time': 1774267813.602716, 'last_price_update_time': 1774874039.190415}
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AH42596') HTTP/1.1" 204 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV89112%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for SV89112: 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW29692%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for LW29692: 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for BJ69368: 2
2026-03-30 12:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-30 12:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 113104dc-3f72-5e09-a1ed-8997aa3362c5 with scrape type 2
2026-03-30 12:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 113104dc-3f72-5e09-a1ed-8997aa3362c5 with scrape type 2
2026-03-30 12:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 113104dc-3f72-5e09-a1ed-8997aa3362c5, identifier: BJ69368
2026-03-30 12:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-30 12:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368
2026-03-30 12:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 113104dc-3f72-5e09-a1ed-8997aa3362c5 with identifier: BJ69368 to the API
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:01:58Z',
'fuel_type': 'diesel',
'id': '113104dc-3f72-5e09-a1ed-8997aa3362c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ69368',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 336247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-09',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Saving data for BJ69368: {'auction_closing_time': 1774882918.0, 'created_time': 1774602411.448214, 'last_price_update_time': 1774874039.651763}
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ69368') HTTP/1.1" 204 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA36833%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for TA36833: 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT44032%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for ZT44032: 0
2026-03-30 12:33:59 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-30 12:33:59 [auto1.it] INFO: Scrape type for TD38619: 2
2026-03-30 12:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-30 12:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with scrape type 2
2026-03-30 12:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with scrape type 2
2026-03-30 12:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac, identifier: TD38619
2026-03-30 12:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-30 12:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619
2026-03-30 12:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 704da0cc-ab15-5eb4-b0a6-55870eb5ddac with identifier: TD38619 to the API
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:19:05Z',
'fuel_type': 'petrol',
'id': '704da0cc-ab15-5eb4-b0a6-55870eb5ddac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD38619',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 276319,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-15',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2013}
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-30 12:34:00 [auto1.it] INFO: Saving data for TD38619: {'auction_closing_time': 1774883945.0, 'created_time': 1773131418.352694, 'last_price_update_time': 1774874040.277619}
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TD38619') HTTP/1.1" 204 0
2026-03-30 12:34:00 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-30 12:34:00 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16147%27 HTTP/1.1" 200 None
2026-03-30 12:34:00 [auto1.it] INFO: Scrape type for GT16147: 0
2026-03-30 12:34:00 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-30 12:34:00 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-30 12:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:01 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT67877%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for ZT67877: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: DJ48929
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ63404%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for NJ63404: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for HV87754: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV86323%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for TV86323: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH27811%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for TH27811: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL48638%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for RL48638: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC65145%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for TC65145: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for MB12953: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for ZM66429: 2
2026-03-30 12:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-30 12:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8391b99d-bff6-5ed4-8d8d-f141e338b44c with scrape type 2
2026-03-30 12:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8391b99d-bff6-5ed4-8d8d-f141e338b44c with scrape type 2
2026-03-30 12:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8391b99d-bff6-5ed4-8d8d-f141e338b44c, identifier: ZM66429
2026-03-30 12:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-30 12:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429
2026-03-30 12:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8391b99d-bff6-5ed4-8d8d-f141e338b44c with identifier: ZM66429 to the API
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:39:02Z',
'fuel_type': 'diesel',
'id': '8391b99d-bff6-5ed4-8d8d-f141e338b44c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM66429',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 179606,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Saving data for ZM66429: {'auction_closing_time': 1774885142.0, 'created_time': 1773136060.453575, 'last_price_update_time': 1774874041.746985}
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM66429') HTTP/1.1" 204 0
2026-03-30 12:34:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for NF87616: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL30811%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for AL30811: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU80477%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for WU80477: 0
2026-03-30 12:34:01 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-30 12:34:01 [auto1.it] INFO: Scrape type for UT43750: 2
2026-03-30 12:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-30 12:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48b4c8ff-417f-5670-9f77-29f5c91fd305 with scrape type 2
2026-03-30 12:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48b4c8ff-417f-5670-9f77-29f5c91fd305 with scrape type 2
2026-03-30 12:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 48b4c8ff-417f-5670-9f77-29f5c91fd305, identifier: UT43750
2026-03-30 12:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-30 12:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750
2026-03-30 12:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 48b4c8ff-417f-5670-9f77-29f5c91fd305 with identifier: UT43750 to the API
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:05:13Z',
'fuel_type': 'petrol',
'id': '48b4c8ff-417f-5670-9f77-29f5c91fd305',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT43750',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 108737,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-29',
'seller_name': None,
'title': 'Smart forfour 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2015}
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Saving data for UT43750: {'auction_closing_time': 1774883113.0, 'created_time': 1773522493.995191, 'last_price_update_time': 1774874042.318314}
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT43750') HTTP/1.1" 204 0
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF97148%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Scrape type for AF97148: 0
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Scrape type for ZU39445: 2
2026-03-30 12:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-30 12:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46545a60-9771-5716-8a72-9d4fb0de3a2a with scrape type 2
2026-03-30 12:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46545a60-9771-5716-8a72-9d4fb0de3a2a with scrape type 2
2026-03-30 12:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 46545a60-9771-5716-8a72-9d4fb0de3a2a, identifier: ZU39445
2026-03-30 12:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-30 12:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445
2026-03-30 12:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 46545a60-9771-5716-8a72-9d4fb0de3a2a with identifier: ZU39445 to the API
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:11Z',
'fuel_type': 'diesel',
'id': '46545a60-9771-5716-8a72-9d4fb0de3a2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU39445',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Aircross',
'odometer': 433775,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-12',
'seller_name': None,
'title': 'Citroen C4 Aircross 1.6 HDi Seduction 2WD',
'transmission': 'manual',
'trim': 'Seduction 2WD',
'year': 2013}
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Saving data for ZU39445: {'auction_closing_time': 1774883831.0, 'created_time': 1774602369.234973, 'last_price_update_time': 1774874042.711416}
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU39445') HTTP/1.1" 204 0
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Scrape type for AM53032: 0
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-30 12:34:02 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-30 12:34:02 [auto1.it] INFO: Scrape type for GC28590: 2
2026-03-30 12:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-30 12:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9380dd8-4869-57e4-a278-120a1961d0bd with scrape type 2
2026-03-30 12:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9380dd8-4869-57e4-a278-120a1961d0bd with scrape type 2
2026-03-30 12:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9380dd8-4869-57e4-a278-120a1961d0bd, identifier: GC28590
2026-03-30 12:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-30 12:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590
2026-03-30 12:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9380dd8-4869-57e4-a278-120a1961d0bd with identifier: GC28590 to the API
2026-03-30 12:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:17:39Z',
'fuel_type': 'hybrid',
'id': 'a9380dd8-4869-57e4-a278-120a1961d0bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC28590',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 66685,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-28',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2021}
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Saving data for GC28590: {'auction_closing_time': 1774883859.0, 'created_time': 1773130637.903386, 'last_price_update_time': 1774874043.168729}
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC28590') HTTP/1.1" 204 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN78187%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for FN78187: 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for CR75802: 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV13161%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for ZV13161: 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79490%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for DC79490: 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW42216%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for ZW42216: 0
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-30 12:34:03 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC91027%27 HTTP/1.1" 200 None
2026-03-30 12:34:03 [auto1.it] INFO: Scrape type for MC91027: 0
2026-03-30 12:34:04 [scrapy.extensions.logstats] INFO: Crawled 266 pages (at 6 pages/min), scraped 164 items (at 15 items/min)
2026-03-30 12:34:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:06 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:06 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG66384%27 HTTP/1.1" 200 None
2026-03-30 12:34:06 [auto1.it] INFO: Scrape type for FG66384: 0
2026-03-30 12:34:06 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-30 12:34:06 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-30 12:34:06 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-30 12:34:06 [auto1.it] INFO: Scrape type for DW35808: 2
2026-03-30 12:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-30 12:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 197d26e9-af65-5a3d-873e-30db2bb00576 with scrape type 2
2026-03-30 12:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 197d26e9-af65-5a3d-873e-30db2bb00576 with scrape type 2
2026-03-30 12:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 197d26e9-af65-5a3d-873e-30db2bb00576, identifier: DW35808
2026-03-30 12:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-30 12:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808
2026-03-30 12:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 197d26e9-af65-5a3d-873e-30db2bb00576 with identifier: DW35808 to the API
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:35:12Z',
'fuel_type': 'diesel',
'id': '197d26e9-af65-5a3d-873e-30db2bb00576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW35808',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 161402,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-27',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2021}
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Saving data for DW35808: {'auction_closing_time': 1774884912.0, 'created_time': 1774275005.076173, 'last_price_update_time': 1774874047.053354}
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW35808') HTTP/1.1" 204 0
2026-03-30 12:34:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ97051%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for MZ97051: 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF95758%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for BF95758: 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for RG06778: 2
2026-03-30 12:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-30 12:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0845609f-0d61-505f-8658-da37744a5288 with scrape type 2
2026-03-30 12:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0845609f-0d61-505f-8658-da37744a5288 with scrape type 2
2026-03-30 12:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0845609f-0d61-505f-8658-da37744a5288, identifier: RG06778
2026-03-30 12:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-30 12:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778
2026-03-30 12:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0845609f-0d61-505f-8658-da37744a5288 with identifier: RG06778 to the API
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:21Z',
'fuel_type': 'diesel',
'id': '0845609f-0d61-505f-8658-da37744a5288',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG06778',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 221864,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-10',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2016}
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Saving data for RG06778: {'auction_closing_time': 1774885581.0, 'created_time': 1774602424.154842, 'last_price_update_time': 1774874047.600891}
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG06778') HTTP/1.1" 204 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS40086%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for PS40086: 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: LB35454
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB35454%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for LB35454: 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH07717%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for XH07717: 0
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-30 12:34:07 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-30 12:34:07 [auto1.it] INFO: Scrape type for HU04780: 2
2026-03-30 12:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-30 12:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24201b62-363b-5048-94ca-f6c86f7c0939 with scrape type 2
2026-03-30 12:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24201b62-363b-5048-94ca-f6c86f7c0939 with scrape type 2
2026-03-30 12:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24201b62-363b-5048-94ca-f6c86f7c0939, identifier: HU04780
2026-03-30 12:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-30 12:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780
2026-03-30 12:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24201b62-363b-5048-94ca-f6c86f7c0939 with identifier: HU04780 to the API
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:04:46Z',
'fuel_type': 'petrol',
'id': '24201b62-363b-5048-94ca-f6c86f7c0939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU04780',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 86545,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-05',
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis pulse',
'transmission': 'automatic',
'trim': 'Basis pulse',
'year': 2009}
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Saving data for HU04780: {'auction_closing_time': 1774883086.0, 'created_time': 1774274814.555555, 'last_price_update_time': 1774874048.0854}
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU04780') HTTP/1.1" 204 0
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Scrape type for JV49964: 2
2026-03-30 12:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-30 12:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a2f4f-189f-5623-85e3-01d5fd49016e with scrape type 2
2026-03-30 12:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8a2f4f-189f-5623-85e3-01d5fd49016e with scrape type 2
2026-03-30 12:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e8a2f4f-189f-5623-85e3-01d5fd49016e, identifier: JV49964
2026-03-30 12:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-30 12:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964
2026-03-30 12:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e8a2f4f-189f-5623-85e3-01d5fd49016e with identifier: JV49964 to the API
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:04:49Z',
'fuel_type': 'petrol',
'id': '3e8a2f4f-189f-5623-85e3-01d5fd49016e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV49964',
'listing': 'auction',
'make': 'Honda',
'model': 'HR-V',
'odometer': 44312,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-23',
'seller_name': None,
'title': 'Honda HR-V 1.5 i-VTEC Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2016}
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Saving data for JV49964: {'auction_closing_time': 1774883089.0, 'created_time': 1774300284.006307, 'last_price_update_time': 1774874048.655792}
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV49964') HTTP/1.1" 204 0
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG41149%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Scrape type for FG41149: 0
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE58096%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Scrape type for HE58096: 0
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM68683%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Scrape type for YM68683: 0
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-30 12:34:08 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-30 12:34:08 [auto1.it] INFO: Scrape type for JU21728: 2
2026-03-30 12:34:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-30 12:34:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with scrape type 2
2026-03-30 12:34:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with scrape type 2
2026-03-30 12:34:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1, identifier: JU21728
2026-03-30 12:34:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-30 12:34:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728
2026-03-30 12:34:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26f996c9-9f8b-5fd5-a798-072e6c16fcd1 with identifier: JU21728 to the API
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:30:18Z',
'fuel_type': 'diesel',
'id': '26f996c9-9f8b-5fd5-a798-072e6c16fcd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU21728',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 94636,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-28',
'seller_name': None,
'title': 'BMW 1er 114d M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2017}
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Saving data for JU21728: {'auction_closing_time': 1774884618.0, 'created_time': 1774602414.823306, 'last_price_update_time': 1774874049.119024}
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JU21728') HTTP/1.1" 204 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD43330%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for BD43330: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW75020%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for EW75020: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for PA42280: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88184%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for WP88184: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY57551%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for LY57551: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS16004%27 HTTP/1.1" 200 None
2026-03-30 12:34:09 [auto1.it] INFO: Scrape type for CS16004: 0
2026-03-30 12:34:09 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-30 12:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:13 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA44632%27 HTTP/1.1" 200 None
2026-03-30 12:34:13 [auto1.it] INFO: Scrape type for HA44632: 0
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-30 12:34:13 [auto1.it] INFO: Scrape type for LW40364: 0
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-30 12:34:13 [auto1.it] INFO: Scrape type for SH22107: 0
2026-03-30 12:34:13 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-30 12:34:13 [auto1.it] INFO: Scrape type for NF26556: 2
2026-03-30 12:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-30 12:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ed4135-2f3e-5710-b32e-7aab4958987a with scrape type 2
2026-03-30 12:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ed4135-2f3e-5710-b32e-7aab4958987a with scrape type 2
2026-03-30 12:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e1ed4135-2f3e-5710-b32e-7aab4958987a, identifier: NF26556
2026-03-30 12:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-30 12:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556
2026-03-30 12:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e1ed4135-2f3e-5710-b32e-7aab4958987a with identifier: NF26556 to the API
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:04:52Z',
'fuel_type': 'petrol',
'id': 'e1ed4135-2f3e-5710-b32e-7aab4958987a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF26556',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 132267,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-30',
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Saving data for NF26556: {'auction_closing_time': 1774883092.0, 'created_time': 1773781763.787489, 'last_price_update_time': 1774874054.300135}
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF26556') HTTP/1.1" 204 0
2026-03-30 12:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23835%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for VE23835: 0
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: US69373
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW16027%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for DW16027: 0
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC90090%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for XC90090: 0
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ08956%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for PZ08956: 0
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK94629%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for TK94629: 0
2026-03-30 12:34:14 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Scrape type for BV29552: 2
2026-03-30 12:34:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-30 12:34:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with scrape type 2
2026-03-30 12:34:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with scrape type 2
2026-03-30 12:34:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97ea31b4-3af1-5a77-b24b-c842f01fcf95, identifier: BV29552
2026-03-30 12:34:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-30 12:34:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552
2026-03-30 12:34:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97ea31b4-3af1-5a77-b24b-c842f01fcf95 with identifier: BV29552 to the API
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:41:52Z',
'fuel_type': 'diesel',
'id': '97ea31b4-3af1-5a77-b24b-c842f01fcf95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV29552',
'listing': 'auction',
'make': 'Audi',
'model': 'A4 Allroad',
'odometer': 229634,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': None,
'title': 'Audi A4 Allroad 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-30 12:34:14 [auto1.it] INFO: Saving data for BV29552: {'auction_closing_time': 1774885312.0, 'created_time': 1772627794.601167, 'last_price_update_time': 1774874054.917188}
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV29552') HTTP/1.1" 204 0
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-30 12:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS11522%27 HTTP/1.1" 200 None
2026-03-30 12:34:15 [auto1.it] INFO: Scrape type for VS11522: 0
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-30 12:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-30 12:34:15 [auto1.it] INFO: Scrape type for YC82026: 0
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-30 12:34:15 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-30 12:34:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:16 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA76603%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for LA76603: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for FY53013: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY40178%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for AY40178: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK76860%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for UK76860: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for WH06276: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for UW72001: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH37521%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for CH37521: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for UM78803: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR67394%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for BR67394: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY31858%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for CY31858: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD01213%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for CD01213: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN26450%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for SN26450: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: YX83263
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP76510%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for CP76510: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52577%27 HTTP/1.1" 200 None
2026-03-30 12:34:16 [auto1.it] INFO: Scrape type for PZ52577: 0
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-30 12:34:16 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-30 12:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:17 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:17 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-30 12:34:17 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-30 12:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG49415%27 HTTP/1.1" 200 None
2026-03-30 12:34:17 [auto1.it] INFO: Scrape type for RG49415: 0
2026-03-30 12:34:17 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-30 12:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-30 12:34:17 [auto1.it] INFO: Scrape type for CV42265: 2
2026-03-30 12:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-30 12:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4634efff-d31b-58db-be84-2a197ad5e800 with scrape type 2
2026-03-30 12:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4634efff-d31b-58db-be84-2a197ad5e800 with scrape type 2
2026-03-30 12:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4634efff-d31b-58db-be84-2a197ad5e800, identifier: CV42265
2026-03-30 12:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-30 12:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265
2026-03-30 12:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4634efff-d31b-58db-be84-2a197ad5e800 with identifier: CV42265 to the API
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:20Z',
'fuel_type': 'diesel',
'id': '4634efff-d31b-58db-be84-2a197ad5e800',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV42265',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 199993,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-07',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Saving data for CV42265: {'auction_closing_time': 1774884680.0, 'created_time': 1773232873.551658, 'last_price_update_time': 1774874058.21323}
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV42265') HTTP/1.1" 204 0
2026-03-30 12:34:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for EB44721: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for LM72883: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for FC91970: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for PR30387: 2
2026-03-30 12:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-30 12:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0b846f0-aec5-59ed-b87e-39cbe1d88023 with scrape type 2
2026-03-30 12:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0b846f0-aec5-59ed-b87e-39cbe1d88023 with scrape type 2
2026-03-30 12:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a0b846f0-aec5-59ed-b87e-39cbe1d88023, identifier: PR30387
2026-03-30 12:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-30 12:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387
2026-03-30 12:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a0b846f0-aec5-59ed-b87e-39cbe1d88023 with identifier: PR30387 to the API
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:40:58Z',
'fuel_type': 'petrol',
'id': 'a0b846f0-aec5-59ed-b87e-39cbe1d88023',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR30387',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 27798,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-06',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2024}
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Saving data for PR30387: {'auction_closing_time': 1774885258.0, 'created_time': 1774274782.180945, 'last_price_update_time': 1774874058.753019}
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR30387') HTTP/1.1" 204 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for TG15136: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33035%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for NP33035: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT98508%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for NT98508: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP78893%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for DP78893: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for ZR71790: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for VS39586: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for HU57000: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG59717%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for TG59717: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for YH14903: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP72281%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for JP72281: 0
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-30 12:34:18 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-30 12:34:18 [auto1.it] INFO: Scrape type for RY04213: 2
2026-03-30 12:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-30 12:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa486cf-c736-5661-9818-5c706ee54e04 with scrape type 2
2026-03-30 12:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa486cf-c736-5661-9818-5c706ee54e04 with scrape type 2
2026-03-30 12:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0aa486cf-c736-5661-9818-5c706ee54e04, identifier: RY04213
2026-03-30 12:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-30 12:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213
2026-03-30 12:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0aa486cf-c736-5661-9818-5c706ee54e04 with identifier: RY04213 to the API
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:37Z',
'fuel_type': 'diesel',
'id': '0aa486cf-c736-5661-9818-5c706ee54e04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY04213',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'New Beetle',
'odometer': 131789,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-28',
'seller_name': None,
'title': 'Volkswagen New Beetle 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-30 12:34:19 [auto1.it] INFO: Saving data for RY04213: {'auction_closing_time': 1774885717.0, 'created_time': 1773136058.982633, 'last_price_update_time': 1774874059.367854}
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY04213') HTTP/1.1" 204 0
2026-03-30 12:34:19 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-30 12:34:19 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-30 12:34:19 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-30 12:34:19 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-30 12:34:19 [auto1.it] INFO: Scrape type for WV91656: 0
2026-03-30 12:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:26 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF27989%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for RF27989: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG94514%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for WG94514: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for KT34727: 2
2026-03-30 12:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-30 12:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554f2825-3090-5972-afb0-0ffeab75b9c9 with scrape type 2
2026-03-30 12:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554f2825-3090-5972-afb0-0ffeab75b9c9 with scrape type 2
2026-03-30 12:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 554f2825-3090-5972-afb0-0ffeab75b9c9, identifier: KT34727
2026-03-30 12:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-30 12:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727
2026-03-30 12:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 554f2825-3090-5972-afb0-0ffeab75b9c9 with identifier: KT34727 to the API
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:21:18Z',
'fuel_type': 'petrol',
'id': '554f2825-3090-5972-afb0-0ffeab75b9c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT34727',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 212741,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TGI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2016}
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Saving data for KT34727: {'auction_closing_time': 1774884078.0, 'created_time': 1774274868.495074, 'last_price_update_time': 1774874066.521258}
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT34727') HTTP/1.1" 204 0
2026-03-30 12:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD07113%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for PD07113: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for ZR58855: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB10468%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for HB10468: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for LG27793: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: BA64945
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for UN52705: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG85862%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for FG85862: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for SR58570: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ76443%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for JJ76443: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG93268%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for AG93268: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: YM91095
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM91095%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for YM91095: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for ME64112: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for LC62662: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for LY59830: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for KW57065: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29519%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for GZ29519: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: UA81726
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for UA81726: 0
2026-03-30 12:34:26 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-30 12:34:26 [auto1.it] INFO: Scrape type for LP45822: 2
2026-03-30 12:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-30 12:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1494abcb-9148-557c-a84a-76588cda64d4 with scrape type 2
2026-03-30 12:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1494abcb-9148-557c-a84a-76588cda64d4 with scrape type 2
2026-03-30 12:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1494abcb-9148-557c-a84a-76588cda64d4, identifier: LP45822
2026-03-30 12:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-30 12:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822
2026-03-30 12:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1494abcb-9148-557c-a84a-76588cda64d4 with identifier: LP45822 to the API
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:14Z',
'fuel_type': 'diesel',
'id': '1494abcb-9148-557c-a84a-76588cda64d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP45822',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 189286,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-21',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2017}
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-30 12:34:27 [auto1.it] INFO: Saving data for LP45822: {'auction_closing_time': 1774885694.0, 'created_time': 1774274773.652799, 'last_price_update_time': 1774874067.229403}
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LP45822') HTTP/1.1" 204 0
2026-03-30 12:34:27 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-30 12:34:27 [auto1.it] INFO: Scrape type for ZZ85760: 2
2026-03-30 12:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-30 12:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b16eb8-2447-501e-ab98-7d71e45ad1ad with scrape type 2
2026-03-30 12:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b16eb8-2447-501e-ab98-7d71e45ad1ad with scrape type 2
2026-03-30 12:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15b16eb8-2447-501e-ab98-7d71e45ad1ad, identifier: ZZ85760
2026-03-30 12:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-30 12:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760
2026-03-30 12:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15b16eb8-2447-501e-ab98-7d71e45ad1ad with identifier: ZZ85760 to the API
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:37:13Z',
'fuel_type': 'petrol',
'id': '15b16eb8-2447-501e-ab98-7d71e45ad1ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ85760',
'listing': 'auction',
'make': 'Seat',
'model': 'Altea',
'odometer': 134099,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'Seat Altea 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2013}
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-30 12:34:27 [auto1.it] INFO: Saving data for ZZ85760: {'auction_closing_time': 1774885033.0, 'created_time': 1772222832.732995, 'last_price_update_time': 1774874067.761315}
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ85760') HTTP/1.1" 204 0
2026-03-30 12:34:27 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-30 12:34:27 [auto1.it] INFO: Scrape type for NR23984: 0
2026-03-30 12:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:35 [auto1.it] INFO: Channel: 24h | Page: 58 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-30 12:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET23172%27 HTTP/1.1" 200 None
2026-03-30 12:34:35 [auto1.it] INFO: Scrape type for ET23172: 0
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-30 12:34:35 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-30 12:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-30 12:34:35 [auto1.it] INFO: Scrape type for ZK25944: 2
2026-03-30 12:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-30 12:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f21246-681b-5f0a-a886-1f27570b079b with scrape type 2
2026-03-30 12:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f21246-681b-5f0a-a886-1f27570b079b with scrape type 2
2026-03-30 12:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4f21246-681b-5f0a-a886-1f27570b079b, identifier: ZK25944
2026-03-30 12:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-30 12:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944
2026-03-30 12:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4f21246-681b-5f0a-a886-1f27570b079b with identifier: ZK25944 to the API
2026-03-30 12:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:41:01Z',
'fuel_type': 'petrol',
'id': 'a4f21246-681b-5f0a-a886-1f27570b079b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK25944',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 29475,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-30',
'seller_name': None,
'title': 'Fiat Panda 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2012}
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Saving data for ZK25944: {'auction_closing_time': 1774885261.0, 'created_time': 1774602440.691375, 'last_price_update_time': 1774874076.129693}
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK25944') HTTP/1.1" 204 0
2026-03-30 12:34:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for VP99832: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE16682%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for JE16682: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP75887%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for VP75887: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF46529%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for AF46529: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT42979%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for UT42979: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA70519%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for PA70519: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for LW86872: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN57194%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for LN57194: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22945%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for HY22945: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG85699%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for JG85699: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for AK60352: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for YA87774: 2
2026-03-30 12:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-30 12:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8574da1e-39e6-523c-97ed-effbcf2aebb4 with scrape type 2
2026-03-30 12:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8574da1e-39e6-523c-97ed-effbcf2aebb4 with scrape type 2
2026-03-30 12:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8574da1e-39e6-523c-97ed-effbcf2aebb4, identifier: YA87774
2026-03-30 12:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-30 12:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774
2026-03-30 12:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8574da1e-39e6-523c-97ed-effbcf2aebb4 with identifier: YA87774 to the API
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:32:36Z',
'fuel_type': 'petrol',
'id': '8574da1e-39e6-523c-97ed-effbcf2aebb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA87774',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 78350,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-23',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Black up!',
'transmission': 'manual',
'trim': 'Black',
'year': 2012}
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Saving data for YA87774: {'auction_closing_time': 1774884756.0, 'created_time': 1774274767.68964, 'last_price_update_time': 1774874076.765755}
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA87774') HTTP/1.1" 204 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for PN28374: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA22015%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for VA22015: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL15395%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for NL15395: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW56281%27 HTTP/1.1" 200 None
2026-03-30 12:34:36 [auto1.it] INFO: Scrape type for ZW56281: 0
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-30 12:34:36 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-30 12:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99467%27 HTTP/1.1" 200 None
2026-03-30 12:34:37 [auto1.it] INFO: Scrape type for GZ99467: 0
2026-03-30 12:34:37 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR85753%27 HTTP/1.1" 200 None
2026-03-30 12:34:37 [auto1.it] INFO: Scrape type for SR85753: 0
2026-03-30 12:34:37 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-30 12:34:37 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-30 12:34:37 [auto1.it] INFO: Scrape type for WD12881: 2
2026-03-30 12:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-30 12:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8bd8467-027d-5672-b2e9-678d305e2445 with scrape type 2
2026-03-30 12:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8bd8467-027d-5672-b2e9-678d305e2445 with scrape type 2
2026-03-30 12:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b8bd8467-027d-5672-b2e9-678d305e2445, identifier: WD12881
2026-03-30 12:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-30 12:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881
2026-03-30 12:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b8bd8467-027d-5672-b2e9-678d305e2445 with identifier: WD12881 to the API
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:12:13Z',
'fuel_type': 'diesel',
'id': 'b8bd8467-027d-5672-b2e9-678d305e2445',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD12881',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 139075,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-26',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2017}
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-30 12:34:37 [auto1.it] INFO: Saving data for WD12881: {'auction_closing_time': 1774883533.0, 'created_time': 1774602449.595466, 'last_price_update_time': 1774874077.405154}
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD12881') HTTP/1.1" 204 0
2026-03-30 12:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:38 [auto1.it] INFO: Channel: 24h | Page: 59 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for WB02861: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for YG18213: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for SY65620: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC37401%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for VC37401: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for PS88419: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for CH30071: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE54964%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for ZE54964: 0
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-30 12:34:38 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-30 12:34:38 [auto1.it] INFO: Scrape type for SH99694: 2
2026-03-30 12:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-30 12:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7d269ba-733d-56ac-8202-8b5db925bea4 with scrape type 2
2026-03-30 12:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7d269ba-733d-56ac-8202-8b5db925bea4 with scrape type 2
2026-03-30 12:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7d269ba-733d-56ac-8202-8b5db925bea4, identifier: SH99694
2026-03-30 12:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-30 12:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694
2026-03-30 12:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7d269ba-733d-56ac-8202-8b5db925bea4 with identifier: SH99694 to the API
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:04:36Z',
'fuel_type': 'diesel',
'id': 'f7d269ba-733d-56ac-8202-8b5db925bea4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH99694',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 304601,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-15',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350 d Shooting Brake BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Saving data for SH99694: {'auction_closing_time': 1774883076.0, 'created_time': 1774300051.818299, 'last_price_update_time': 1774874079.196339}
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH99694') HTTP/1.1" 204 0
2026-03-30 12:34:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD47870%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for YD47870: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for CA11225: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ15334%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for GZ15334: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for NR19227: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for CD48597: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for ZL42866: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ15341%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for FZ15341: 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Scrape type for FB65897: 2
2026-03-30 12:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-30 12:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b18727-b23c-5d6c-8faa-e711dbc8882e with scrape type 2
2026-03-30 12:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b18727-b23c-5d6c-8faa-e711dbc8882e with scrape type 2
2026-03-30 12:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9b18727-b23c-5d6c-8faa-e711dbc8882e, identifier: FB65897
2026-03-30 12:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-30 12:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897
2026-03-30 12:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9b18727-b23c-5d6c-8faa-e711dbc8882e with identifier: FB65897 to the API
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:21:36Z',
'fuel_type': 'diesel',
'id': 'a9b18727-b23c-5d6c-8faa-e711dbc8882e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB65897',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 216490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-23',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2018}
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-30 12:34:39 [auto1.it] INFO: Saving data for FB65897: {'auction_closing_time': 1774884096.0, 'created_time': 1772622818.788718, 'last_price_update_time': 1774874079.875242}
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB65897') HTTP/1.1" 204 0
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-30 12:34:39 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-30 12:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30560%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Scrape type for JD30560: 0
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: TW16481
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW16481%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Scrape type for TW16481: 0
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS41050%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Scrape type for RS41050: 0
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD38461%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Scrape type for KD38461: 0
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Scrape type for HG18459: 2
2026-03-30 12:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-30 12:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e146d5a1-6e2f-587e-870f-0b09040b3b78 with scrape type 2
2026-03-30 12:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e146d5a1-6e2f-587e-870f-0b09040b3b78 with scrape type 2
2026-03-30 12:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e146d5a1-6e2f-587e-870f-0b09040b3b78, identifier: HG18459
2026-03-30 12:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-30 12:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459
2026-03-30 12:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e146d5a1-6e2f-587e-870f-0b09040b3b78 with identifier: HG18459 to the API
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:06:03Z',
'fuel_type': 'diesel',
'id': 'e146d5a1-6e2f-587e-870f-0b09040b3b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG18459',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 149916,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-23',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-30 12:34:40 [auto1.it] INFO: Saving data for HG18459: {'auction_closing_time': 1774883163.0, 'created_time': 1774602352.618556, 'last_price_update_time': 1774874080.496496}
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG18459') HTTP/1.1" 204 0
2026-03-30 12:34:40 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-30 12:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:44 [auto1.it] INFO: Channel: 24h | Page: 60 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:44 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-30 12:34:44 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-30 12:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-30 12:34:44 [auto1.it] INFO: Scrape type for HS22192: 0
2026-03-30 12:34:44 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-30 12:34:44 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-30 12:34:44 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-30 12:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-30 12:34:44 [auto1.it] INFO: Scrape type for XC32215: 2
2026-03-30 12:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-30 12:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33055a65-0e52-5536-baa6-99bd91d3d112 with scrape type 2
2026-03-30 12:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33055a65-0e52-5536-baa6-99bd91d3d112 with scrape type 2
2026-03-30 12:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33055a65-0e52-5536-baa6-99bd91d3d112, identifier: XC32215
2026-03-30 12:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-30 12:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215
2026-03-30 12:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33055a65-0e52-5536-baa6-99bd91d3d112 with identifier: XC32215 to the API
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:08:02Z',
'fuel_type': 'petrol',
'id': '33055a65-0e52-5536-baa6-99bd91d3d112',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC32215',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 58596,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-20',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2016}
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Saving data for XC32215: {'auction_closing_time': 1774883282.0, 'created_time': 1774602365.78909, 'last_price_update_time': 1774874085.311548}
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC32215') HTTP/1.1" 204 0
2026-03-30 12:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ93406%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Scrape type for VJ93406: 0
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Scrape type for HA39708: 0
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Scrape type for SG53706: 2
2026-03-30 12:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-30 12:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3ab0eb-3c2e-525b-806a-d111f53af72e with scrape type 2
2026-03-30 12:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb3ab0eb-3c2e-525b-806a-d111f53af72e with scrape type 2
2026-03-30 12:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb3ab0eb-3c2e-525b-806a-d111f53af72e, identifier: SG53706
2026-03-30 12:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-30 12:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706
2026-03-30 12:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb3ab0eb-3c2e-525b-806a-d111f53af72e with identifier: SG53706 to the API
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:40:14Z',
'fuel_type': 'diesel',
'id': 'bb3ab0eb-3c2e-525b-806a-d111f53af72e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG53706',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 315098,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-07-20',
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2004}
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Saving data for SG53706: {'auction_closing_time': 1774885214.0, 'created_time': 1774602371.729465, 'last_price_update_time': 1774874085.748004}
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SG53706') HTTP/1.1" 204 0
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Scrape type for XC82626: 0
2026-03-30 12:34:45 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-30 12:34:45 [auto1.it] INFO: Scrape type for RL61545: 2
2026-03-30 12:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-30 12:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9f6915-76f2-566d-aefb-1aad37714f99 with scrape type 2
2026-03-30 12:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9f6915-76f2-566d-aefb-1aad37714f99 with scrape type 2
2026-03-30 12:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de9f6915-76f2-566d-aefb-1aad37714f99, identifier: RL61545
2026-03-30 12:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-30 12:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545
2026-03-30 12:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de9f6915-76f2-566d-aefb-1aad37714f99 with identifier: RL61545 to the API
2026-03-30 12:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:39:43Z',
'fuel_type': 'diesel',
'id': 'de9f6915-76f2-566d-aefb-1aad37714f99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL61545',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 192906,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2011}
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Saving data for RL61545: {'auction_closing_time': 1774885183.0, 'created_time': 1774602333.518208, 'last_price_update_time': 1774874086.189106}
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL61545') HTTP/1.1" 204 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU47897%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for CU47897: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for SU56229: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN01400%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for PN01400: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: YW98083
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW98083%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for YW98083: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for MM82110: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for YM64414: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for MD14180: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW88913%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for KW88913: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for YT99583: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU32452%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for WU32452: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30640%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for JD30640: 0
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-30 12:34:46 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Scrape type for MU61390: 2
2026-03-30 12:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-30 12:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18c0b116-93b5-579a-aa61-1afce1a8afcd with scrape type 2
2026-03-30 12:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18c0b116-93b5-579a-aa61-1afce1a8afcd with scrape type 2
2026-03-30 12:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18c0b116-93b5-579a-aa61-1afce1a8afcd, identifier: MU61390
2026-03-30 12:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-30 12:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390
2026-03-30 12:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18c0b116-93b5-579a-aa61-1afce1a8afcd with identifier: MU61390 to the API
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:00:29Z',
'fuel_type': 'diesel',
'id': '18c0b116-93b5-579a-aa61-1afce1a8afcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU61390',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 192655,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-29',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2007}
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-30 12:34:46 [auto1.it] INFO: Saving data for MU61390: {'auction_closing_time': 1774882829.0, 'created_time': 1774101982.98848, 'last_price_update_time': 1774874086.949329}
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MU61390') HTTP/1.1" 204 0
2026-03-30 12:34:47 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-30 12:34:47 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08559%27 HTTP/1.1" 200 None
2026-03-30 12:34:47 [auto1.it] INFO: Scrape type for VY08559: 0
2026-03-30 12:34:47 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-30 12:34:47 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-30 12:34:47 [auto1.it] INFO: Scrape type for PV59173: 2
2026-03-30 12:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-30 12:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with scrape type 2
2026-03-30 12:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with scrape type 2
2026-03-30 12:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745, identifier: PV59173
2026-03-30 12:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-30 12:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173
2026-03-30 12:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b039a2d-05ac-51c8-89f1-fe6a97fd5745 with identifier: PV59173 to the API
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:06:11Z',
'fuel_type': 'petrol',
'id': '6b039a2d-05ac-51c8-89f1-fe6a97fd5745',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV59173',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 137881,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-29',
'seller_name': None,
'title': 'Peugeot 107 1.0 Desir',
'transmission': 'manual',
'trim': 'Desir',
'year': 2010}
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-30 12:34:47 [auto1.it] INFO: Saving data for PV59173: {'auction_closing_time': 1774883171.0, 'created_time': 1773304737.617318, 'last_price_update_time': 1774874087.474584}
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV59173') HTTP/1.1" 204 0
2026-03-30 12:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:34:48 [auto1.it] INFO: Channel: 24h | Page: 61 | totalHits: 3592 | hits on page: 40
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for UR28230: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39462%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for XJ39462: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK87302%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for DK87302: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for WD34729: 2
2026-03-30 12:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-30 12:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36564643-d038-5dda-a81d-9c1e3fcfb76f with scrape type 2
2026-03-30 12:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36564643-d038-5dda-a81d-9c1e3fcfb76f with scrape type 2
2026-03-30 12:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36564643-d038-5dda-a81d-9c1e3fcfb76f, identifier: WD34729
2026-03-30 12:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-30 12:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729
2026-03-30 12:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36564643-d038-5dda-a81d-9c1e3fcfb76f with identifier: WD34729 to the API
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:46:59Z',
'fuel_type': 'gas',
'id': '36564643-d038-5dda-a81d-9c1e3fcfb76f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD34729',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 99476,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-20',
'seller_name': None,
'title': 'Opel Corsa 1.2 Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2012}
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Saving data for WD34729: {'auction_closing_time': 1774885619.0, 'created_time': 1773131822.927658, 'last_price_update_time': 1774874088.91468}
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD34729') HTTP/1.1" 204 0
2026-03-30 12:34:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for KG02437: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY21369%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for PY21369: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: YH78085
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ72377%27 HTTP/1.1" 200 None
2026-03-30 12:34:48 [auto1.it] INFO: Scrape type for LZ72377: 0
2026-03-30 12:34:48 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-30 12:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM78443%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for VM78443: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS56995%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for MS56995: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY41121%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for XY41121: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for GX81106: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG73673%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for HG73673: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA21374%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for PA21374: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX18897%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for DX18897: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC73004%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for FC73004: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for LS28867: 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for EZ27389: 2
2026-03-30 12:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-30 12:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b64cd217-0dbc-509e-a661-76b6e8a3d522 with scrape type 2
2026-03-30 12:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b64cd217-0dbc-509e-a661-76b6e8a3d522 with scrape type 2
2026-03-30 12:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b64cd217-0dbc-509e-a661-76b6e8a3d522, identifier: EZ27389
2026-03-30 12:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-30 12:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389
2026-03-30 12:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b64cd217-0dbc-509e-a661-76b6e8a3d522 with identifier: EZ27389 to the API
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:03:03Z',
'fuel_type': 'gas',
'id': 'b64cd217-0dbc-509e-a661-76b6e8a3d522',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ27389',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 143460,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-30',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Benzin / LPG Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Saving data for EZ27389: {'auction_closing_time': 1774882983.0, 'created_time': 1774274893.852543, 'last_price_update_time': 1774874089.575124}
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ27389') HTTP/1.1" 204 0
2026-03-30 12:34:49 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-30 12:34:49 [auto1.it] INFO: Scrape type for EZ66710: 2
2026-03-30 12:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-30 12:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with scrape type 2
2026-03-30 12:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with scrape type 2
2026-03-30 12:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07a31df6-e5bb-5b02-b66f-e8314a5a9568, identifier: EZ66710
2026-03-30 12:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-30 12:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710
2026-03-30 12:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07a31df6-e5bb-5b02-b66f-e8314a5a9568 with identifier: EZ66710 to the API
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:53:30Z',
'fuel_type': 'diesel',
'id': '07a31df6-e5bb-5b02-b66f-e8314a5a9568',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ66710',
'listing': 'auction',
'make': 'Audi',
'model': 'Q8',
'odometer': 150868,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-10',
'seller_name': None,
'title': 'Audi Q8 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-30 12:34:50 [auto1.it] INFO: Saving data for EZ66710: {'auction_closing_time': 1774886010.0, 'created_time': 1774274804.906892, 'last_price_update_time': 1774874090.098248}
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ66710') HTTP/1.1" 204 0
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-30 12:34:50 [auto1.it] INFO: Scrape type for DP87516: 0
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV60834%27 HTTP/1.1" 200 None
2026-03-30 12:34:50 [auto1.it] INFO: Scrape type for DV60834: 0
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG24306%27 HTTP/1.1" 200 None
2026-03-30 12:34:50 [auto1.it] INFO: Scrape type for TG24306: 0
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC99456%27 HTTP/1.1" 200 None
2026-03-30 12:34:50 [auto1.it] INFO: Scrape type for PC99456: 0
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-30 12:34:50 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-30 12:35:04 [scrapy.extensions.logstats] INFO: Crawled 275 pages (at 9 pages/min), scraped 191 items (at 27 items/min)
2026-03-30 12:35:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:08 [auto1.it] INFO: Channel: 24h | Page: 62 | totalHits: 3592 | hits on page: 40
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for VE26782: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU78402%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for JU78402: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68446%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for CZ68446: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU69652%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for UU69652: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH17825%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for WH17825: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: MT44233
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR14764%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for UR14764: 0
2026-03-30 12:35:08 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-30 12:35:08 [auto1.it] INFO: Scrape type for HR66434: 2
2026-03-30 12:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-30 12:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with scrape type 2
2026-03-30 12:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with scrape type 2
2026-03-30 12:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1, identifier: HR66434
2026-03-30 12:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-30 12:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434
2026-03-30 12:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ffe0dd0-40a2-50ef-8c66-07beb24157b1 with identifier: HR66434 to the API
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:40Z',
'fuel_type': 'diesel',
'id': '0ffe0dd0-40a2-50ef-8c66-07beb24157b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR66434',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 249190,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-20',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2015}
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Saving data for HR66434: {'auction_closing_time': 1774883980.0, 'created_time': 1774602427.224447, 'last_price_update_time': 1774874109.012417}
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HR66434') HTTP/1.1" 204 0
2026-03-30 12:35:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05972%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Scrape type for GF05972: 0
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK06699%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Scrape type for YK06699: 0
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Scrape type for JR97776: 0
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF31033%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Scrape type for KF31033: 0
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-30 12:35:09 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-30 12:35:09 [auto1.it] INFO: Scrape type for FT76605: 2
2026-03-30 12:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-30 12:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff2849b-894f-5c33-a81c-470838157e7b with scrape type 2
2026-03-30 12:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff2849b-894f-5c33-a81c-470838157e7b with scrape type 2
2026-03-30 12:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ff2849b-894f-5c33-a81c-470838157e7b, identifier: FT76605
2026-03-30 12:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-30 12:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605
2026-03-30 12:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ff2849b-894f-5c33-a81c-470838157e7b with identifier: FT76605 to the API
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:13:18Z',
'fuel_type': 'diesel',
'id': '5ff2849b-894f-5c33-a81c-470838157e7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT76605',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 110287,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-03',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Dynamic Start/Stop',
'transmission': 'manual',
'trim': 'Dynamic Start/Stop',
'year': 2019}
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Saving data for FT76605: {'auction_closing_time': 1774883598.0, 'created_time': 1773136059.512628, 'last_price_update_time': 1774874110.076694}
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FT76605') HTTP/1.1" 204 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY35916%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for JY35916: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for GD10861: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46265%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for JA46265: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET57280%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for ET57280: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN99534%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for DN99534: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ23148%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for XJ23148: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU33914%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for YU33914: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for GC53002: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: FZ67880
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA58857%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for GA58857: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY96828%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for VY96828: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-30 12:35:10 [auto1.it] INFO: Scrape type for AN61279: 0
2026-03-30 12:35:10 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-30 12:35:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:11 [auto1.it] INFO: Channel: 24h | Page: 63 | totalHits: 3592 | hits on page: 40
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80724%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for FL80724: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN78206%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for SN78206: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: AN14799
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN14799%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for AN14799: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for HG91847: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW69655%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for NW69655: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER04044%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for ER04044: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR62667%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for HR62667: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for TN35413: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG86392%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for ZG86392: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH76883%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for PH76883: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for MJ42614: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93737%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for PZ93737: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL07806%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for ZL07806: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG74352%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for XG74352: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for GV49335: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ64167%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for AZ64167: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for BD88975: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for EH51725: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for JR54731: 0
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-30 12:35:11 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW35893%27 HTTP/1.1" 200 None
2026-03-30 12:35:11 [auto1.it] INFO: Scrape type for YW35893: 0
2026-03-30 12:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:12 [auto1.it] INFO: Channel: 24h | Page: 64 | totalHits: 3592 | hits on page: 40
2026-03-30 12:35:12 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG42626%27 HTTP/1.1" 200 None
2026-03-30 12:35:12 [auto1.it] INFO: Scrape type for TG42626: 0
2026-03-30 12:35:12 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-30 12:35:12 [auto1.it] INFO: Scrape type for WN42286: 0
2026-03-30 12:35:12 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-30 12:35:12 [auto1.it] INFO: Scrape type for MP39083: 0
2026-03-30 12:35:12 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB00155%27 HTTP/1.1" 200 None
2026-03-30 12:35:12 [auto1.it] INFO: Scrape type for XB00155: 0
2026-03-30 12:35:12 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-30 12:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24825%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for UZ24825: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT33776%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for WT33776: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for RS22306: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU70753%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for RU70753: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for NP16593: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT23346%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for JT23346: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for TJ20772: 2
2026-03-30 12:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-30 12:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with scrape type 2
2026-03-30 12:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with scrape type 2
2026-03-30 12:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a, identifier: TJ20772
2026-03-30 12:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-30 12:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772
2026-03-30 12:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3c4b75d-fea7-595c-ae84-2925ccc6cb9a with identifier: TJ20772 to the API
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:23:58Z',
'fuel_type': 'diesel',
'id': 'e3c4b75d-fea7-595c-ae84-2925ccc6cb9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ20772',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 80017,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-05',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Energy Grand Business Edition',
'transmission': 'automatic',
'trim': 'Grand Business Edition',
'year': 2018}
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Saving data for TJ20772: {'auction_closing_time': 1774884238.0, 'created_time': 1774602417.806159, 'last_price_update_time': 1774874113.599435}
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ20772') HTTP/1.1" 204 0
2026-03-30 12:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for JM76846: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for UT67830: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU27646%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for RU27646: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM78801%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for WM78801: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ37840%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for RJ37840: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ26377%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for TZ26377: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG41470%27 HTTP/1.1" 200 None
2026-03-30 12:35:13 [auto1.it] INFO: Scrape type for EG41470: 0
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-30 12:35:13 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-30 12:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:14 [auto1.it] INFO: Channel: 24h | Page: 65 | totalHits: 3593 | hits on page: 40
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-30 12:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-30 12:35:14 [auto1.it] INFO: Scrape type for VC06734: 0
2026-03-30 12:35:14 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-30 12:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-30 12:35:14 [auto1.it] INFO: Scrape type for ZM35614: 2
2026-03-30 12:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-30 12:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64bffd1f-b745-5109-b8e3-95fd732bbb65 with scrape type 2
2026-03-30 12:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64bffd1f-b745-5109-b8e3-95fd732bbb65 with scrape type 2
2026-03-30 12:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64bffd1f-b745-5109-b8e3-95fd732bbb65, identifier: ZM35614
2026-03-30 12:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-30 12:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614
2026-03-30 12:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64bffd1f-b745-5109-b8e3-95fd732bbb65 with identifier: ZM35614 to the API
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:47:51Z',
'fuel_type': 'diesel',
'id': '64bffd1f-b745-5109-b8e3-95fd732bbb65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM35614',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 198475,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Saving data for ZM35614: {'auction_closing_time': 1774885671.0, 'created_time': 1774274748.973551, 'last_price_update_time': 1774874115.353785}
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZM35614') HTTP/1.1" 204 0
2026-03-30 12:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for YY46039: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: JJ50665
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ50665%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for JJ50665: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for XN19179: 2
2026-03-30 12:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-30 12:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5eb161d-dc48-55b5-99a8-a028a7be7e88 with scrape type 2
2026-03-30 12:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5eb161d-dc48-55b5-99a8-a028a7be7e88 with scrape type 2
2026-03-30 12:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5eb161d-dc48-55b5-99a8-a028a7be7e88, identifier: XN19179
2026-03-30 12:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-30 12:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179
2026-03-30 12:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5eb161d-dc48-55b5-99a8-a028a7be7e88 with identifier: XN19179 to the API
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:31:24Z',
'fuel_type': 'diesel',
'id': 'a5eb161d-dc48-55b5-99a8-a028a7be7e88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN19179',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 93700,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Duel',
'transmission': 'manual',
'trim': 'Duel',
'year': 2016}
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Saving data for XN19179: {'auction_closing_time': 1774884684.0, 'created_time': 1773129501.044921, 'last_price_update_time': 1774874115.884097}
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XN19179') HTTP/1.1" 204 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD08971%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for MD08971: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY69981%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for KY69981: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN39146%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for HN39146: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for MG67619: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA22905%27 HTTP/1.1" 200 None
2026-03-30 12:35:15 [auto1.it] INFO: Scrape type for YA22905: 0
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-30 12:35:15 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-30 12:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW30840%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Scrape type for SW30840: 0
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU63843%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Scrape type for PU63843: 0
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Scrape type for LX64348: 2
2026-03-30 12:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-30 12:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e783db1c-85c0-5309-b73f-cc9f6585a184 with scrape type 2
2026-03-30 12:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e783db1c-85c0-5309-b73f-cc9f6585a184 with scrape type 2
2026-03-30 12:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e783db1c-85c0-5309-b73f-cc9f6585a184, identifier: LX64348
2026-03-30 12:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-30 12:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348
2026-03-30 12:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e783db1c-85c0-5309-b73f-cc9f6585a184 with identifier: LX64348 to the API
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:05:07Z',
'fuel_type': 'diesel',
'id': 'e783db1c-85c0-5309-b73f-cc9f6585a184',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX64348',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 173281,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-28',
'seller_name': None,
'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid High Tech',
'transmission': 'automatic',
'trim': 'High Tech',
'year': 2021}
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Saving data for LX64348: {'auction_closing_time': 1774883107.0, 'created_time': 1772273158.057487, 'last_price_update_time': 1774874116.465182}
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LX64348') HTTP/1.1" 204 0
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP08653%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Scrape type for ZP08653: 0
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-30 12:35:16 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-30 12:35:16 [auto1.it] INFO: Scrape type for WW68303: 2
2026-03-30 12:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-30 12:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with scrape type 2
2026-03-30 12:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with scrape type 2
2026-03-30 12:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24fe4699-30e4-5c0b-9432-43c232bc1cb2, identifier: WW68303
2026-03-30 12:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-30 12:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303
2026-03-30 12:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24fe4699-30e4-5c0b-9432-43c232bc1cb2 with identifier: WW68303 to the API
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:53:48Z',
'fuel_type': 'diesel',
'id': '24fe4699-30e4-5c0b-9432-43c232bc1cb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW68303',
'listing': 'auction',
'make': 'Lancia',
'model': 'Voyager',
'odometer': 161937,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-13',
'seller_name': None,
'title': 'Lancia Voyager 2.8 JTDM Gold',
'transmission': 'automatic',
'trim': 'Gold',
'year': 2013}
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Saving data for WW68303: {'auction_closing_time': 1774886028.0, 'created_time': 1773436389.8291, 'last_price_update_time': 1774874117.024658}
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WW68303') HTTP/1.1" 204 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for LT86375: 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for RK63045: 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for PG53512: 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF38082%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for NF38082: 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for RA25408: 2
2026-03-30 12:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-30 12:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-03-30 12:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 741d7026-0aac-5c3b-8af5-ab758388ede6 with scrape type 2
2026-03-30 12:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 741d7026-0aac-5c3b-8af5-ab758388ede6, identifier: RA25408
2026-03-30 12:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-30 12:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408
2026-03-30 12:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 741d7026-0aac-5c3b-8af5-ab758388ede6 with identifier: RA25408 to the API
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:25:26Z',
'fuel_type': 'hybrid',
'id': '741d7026-0aac-5c3b-8af5-ab758388ede6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA25408',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 81577,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-02',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid XLine 2WD',
'transmission': 'automatic',
'trim': 'XLine 2WD',
'year': 2023}
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Saving data for RA25408: {'auction_closing_time': 1774884326.0, 'created_time': 1774602374.784215, 'last_price_update_time': 1774874117.651921}
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA25408') HTTP/1.1" 204 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for YB05417: 0
2026-03-30 12:35:17 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-30 12:35:17 [auto1.it] INFO: Scrape type for PT68883: 2
2026-03-30 12:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-30 12:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with scrape type 2
2026-03-30 12:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with scrape type 2
2026-03-30 12:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e, identifier: PT68883
2026-03-30 12:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-30 12:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883
2026-03-30 12:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3ed5a5e-e4c3-5c91-a977-c2a2e187575e with identifier: PT68883 to the API
2026-03-30 12:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:12:32Z',
'fuel_type': 'diesel',
'id': 'e3ed5a5e-e4c3-5c91-a977-c2a2e187575e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT68883',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 371603,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-04',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-30 12:35:18 [auto1.it] INFO: Saving data for PT68883: {'auction_closing_time': 1774883552.0, 'created_time': 1774300080.874205, 'last_price_update_time': 1774874118.16122}
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT68883') HTTP/1.1" 204 0
2026-03-30 12:35:18 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH73900%27 HTTP/1.1" 200 None
2026-03-30 12:35:18 [auto1.it] INFO: Scrape type for YH73900: 0
2026-03-30 12:35:18 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-30 12:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:19 [auto1.it] INFO: Channel: 24h | Page: 66 | totalHits: 3593 | hits on page: 40
2026-03-30 12:35:19 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.it] INFO: Scrape type for LH69939: 0
2026-03-30 12:35:19 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93618%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.it] INFO: Scrape type for FA93618: 0
2026-03-30 12:35:19 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-30 12:35:19 [auto1.it] INFO: Scrape type for LD48805: 2
2026-03-30 12:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-30 12:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with scrape type 2
2026-03-30 12:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with scrape type 2
2026-03-30 12:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b, identifier: LD48805
2026-03-30 12:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-30 12:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805
2026-03-30 12:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b with identifier: LD48805 to the API
2026-03-30 12:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:07Z',
'fuel_type': 'diesel',
'id': 'ab6f4738-f5f4-59a7-9b7f-84b5f2c6dc9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD48805',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 169245,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-09',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Saving data for LD48805: {'auction_closing_time': 1774884367.0, 'created_time': 1772309276.607462, 'last_price_update_time': 1774874120.15982}
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD48805') HTTP/1.1" 204 0
2026-03-30 12:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR14904%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for BR14904: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for HX42058: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for BN39787: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for TA87203: 2
2026-03-30 12:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-30 12:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f843af54-972f-516e-a4ff-0defbcfdd66a with scrape type 2
2026-03-30 12:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f843af54-972f-516e-a4ff-0defbcfdd66a with scrape type 2
2026-03-30 12:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f843af54-972f-516e-a4ff-0defbcfdd66a, identifier: TA87203
2026-03-30 12:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-30 12:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203
2026-03-30 12:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f843af54-972f-516e-a4ff-0defbcfdd66a with identifier: TA87203 to the API
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:19:45Z',
'fuel_type': 'diesel',
'id': 'f843af54-972f-516e-a4ff-0defbcfdd66a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA87203',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 82996,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-26',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 220 d AVANTGARDE kompakt',
'transmission': 'automatic',
'trim': 'AVANTGARDE kompakt',
'year': 2021}
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Saving data for TA87203: {'auction_closing_time': 1774883985.0, 'created_time': 1773132409.663516, 'last_price_update_time': 1774874120.676621}
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TA87203') HTTP/1.1" 204 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for DW89993: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB60435%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for TB60435: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ09783%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for ZJ09783: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for GG79286: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG33831%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for VG33831: 0
2026-03-30 12:35:20 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-30 12:35:20 [auto1.it] INFO: Scrape type for SL84548: 2
2026-03-30 12:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-30 12:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e86d13e-8fdb-518e-baaa-502034ed19bc with scrape type 2
2026-03-30 12:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e86d13e-8fdb-518e-baaa-502034ed19bc with scrape type 2
2026-03-30 12:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e86d13e-8fdb-518e-baaa-502034ed19bc, identifier: SL84548
2026-03-30 12:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-30 12:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548
2026-03-30 12:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e86d13e-8fdb-518e-baaa-502034ed19bc with identifier: SL84548 to the API
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:48:58Z',
'fuel_type': 'gas',
'id': '6e86d13e-8fdb-518e-baaa-502034ed19bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL84548',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 147082,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-29',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Benzin / LPG Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Saving data for SL84548: {'auction_closing_time': 1774885738.0, 'created_time': 1774602427.945628, 'last_price_update_time': 1774874121.27787}
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SL84548') HTTP/1.1" 204 0
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Scrape type for ZV75074: 2
2026-03-30 12:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-30 12:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7b1e40-154b-554e-9007-1d93126c7e0f with scrape type 2
2026-03-30 12:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7b1e40-154b-554e-9007-1d93126c7e0f with scrape type 2
2026-03-30 12:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e7b1e40-154b-554e-9007-1d93126c7e0f, identifier: ZV75074
2026-03-30 12:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-30 12:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074
2026-03-30 12:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e7b1e40-154b-554e-9007-1d93126c7e0f with identifier: ZV75074 to the API
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:11:06Z',
'fuel_type': 'petrol',
'id': '2e7b1e40-154b-554e-9007-1d93126c7e0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV75074',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 98301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-21',
'seller_name': None,
'title': 'Fiat Panda 1.2 Natural Power Panda',
'transmission': 'manual',
'trim': 'Natural Power',
'year': 2010}
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Saving data for ZV75074: {'auction_closing_time': 1774883466.0, 'created_time': 1774300239.052066, 'last_price_update_time': 1774874121.757762}
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZV75074') HTTP/1.1" 204 0
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: JZ46948
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ46948%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Scrape type for JZ46948: 0
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ84756%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Scrape type for DZ84756: 0
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Scrape type for DC62247: 0
2026-03-30 12:35:21 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-30 12:35:21 [auto1.it] INFO: Scrape type for KD87590: 2
2026-03-30 12:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-30 12:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a44fbf-633a-5696-a4d4-d3398573fc86 with scrape type 2
2026-03-30 12:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68a44fbf-633a-5696-a4d4-d3398573fc86 with scrape type 2
2026-03-30 12:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68a44fbf-633a-5696-a4d4-d3398573fc86, identifier: KD87590
2026-03-30 12:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-30 12:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-03-30 12:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590 to the API
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:11:41Z',
'fuel_type': 'diesel',
'id': '68a44fbf-633a-5696-a4d4-d3398573fc86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD87590',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 241530,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-09',
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Saving data for KD87590: {'auction_closing_time': 1774883501.0, 'created_time': 1774602423.727793, 'last_price_update_time': 1774874122.216295}
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KD87590') HTTP/1.1" 204 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH32473%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for JH32473: 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG76075%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for VG76075: 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for HW82018: 2
2026-03-30 12:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-30 12:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with scrape type 2
2026-03-30 12:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with scrape type 2
2026-03-30 12:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5, identifier: HW82018
2026-03-30 12:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-30 12:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018
2026-03-30 12:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5 with identifier: HW82018 to the API
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:30Z',
'fuel_type': 'diesel',
'id': 'ceaabe01-cb5b-53dc-bf07-a0fde05d5fe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW82018',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 166990,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-21',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Saving data for HW82018: {'auction_closing_time': 1774885290.0, 'created_time': 1773135688.439802, 'last_price_update_time': 1774874122.674699}
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HW82018') HTTP/1.1" 204 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA98059%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for KA98059: 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL87170%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for FL87170: 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for RF11851: 0
2026-03-30 12:35:22 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-30 12:35:22 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-30 12:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:35:40 [auto1.it] INFO: Channel: 24h | Page: 67 | totalHits: 3594 | hits on page: 40
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU40150%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for NU40150: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA02667%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for HA02667: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for KT00361: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF04289%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for ZF04289: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF98355%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for WF98355: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for RY75551: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW10693%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for PW10693: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF43689%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for RF43689: 0
2026-03-30 12:35:40 [auto1.it] INFO: Found listing with ID: US24028
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-30 12:35:40 [auto1.it] INFO: Scrape type for US24028: 2
2026-03-30 12:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-30 12:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6047d389-5c8a-5622-932a-8e15f5c7aa4c with scrape type 2
2026-03-30 12:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6047d389-5c8a-5622-932a-8e15f5c7aa4c with scrape type 2
2026-03-30 12:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6047d389-5c8a-5622-932a-8e15f5c7aa4c, identifier: US24028
2026-03-30 12:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-30 12:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028
2026-03-30 12:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6047d389-5c8a-5622-932a-8e15f5c7aa4c with identifier: US24028 to the API
2026-03-30 12:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:28:07Z',
'fuel_type': 'diesel',
'id': '6047d389-5c8a-5622-932a-8e15f5c7aa4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US24028',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 211228,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-06',
'seller_name': None,
'title': 'Fiat Doblo 1.3 M-Jet SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2019}
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Saving data for US24028: {'auction_closing_time': 1774884487.0, 'created_time': 1774602440.169646, 'last_price_update_time': 1774874142.565772}
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='US24028') HTTP/1.1" 204 0
2026-03-30 12:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS07739%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Scrape type for AS07739: 0
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB18666%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Scrape type for VB18666: 0
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Scrape type for ND31908: 0
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ18858%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Scrape type for XJ18858: 0
2026-03-30 12:35:42 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-30 12:35:42 [auto1.it] INFO: Scrape type for RS54948: 2
2026-03-30 12:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-30 12:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830d0c2-62f4-5eff-a11a-65dad054cb64 with scrape type 2
2026-03-30 12:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e830d0c2-62f4-5eff-a11a-65dad054cb64 with scrape type 2
2026-03-30 12:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e830d0c2-62f4-5eff-a11a-65dad054cb64, identifier: RS54948
2026-03-30 12:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-30 12:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948
2026-03-30 12:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e830d0c2-62f4-5eff-a11a-65dad054cb64 with identifier: RS54948 to the API
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:34Z',
'fuel_type': 'petrol',
'id': 'e830d0c2-62f4-5eff-a11a-65dad054cb64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS54948',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 183194,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-25',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2010}
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Saving data for RS54948: {'auction_closing_time': 1774885714.0, 'created_time': 1772104608.628115, 'last_price_update_time': 1774874143.23562}
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS54948') HTTP/1.1" 204 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP40750%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for NP40750: 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42722%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for VT42722: 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for XJ13084: 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS02463%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for DS02463: 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for VP48054: 0
2026-03-30 12:35:43 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU99331%27 HTTP/1.1" 200 None
2026-03-30 12:35:43 [auto1.it] INFO: Scrape type for FU99331: 0
2026-03-30 12:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:00 [auto1.it] INFO: Channel: 24h | Page: 68 | totalHits: 3594 | hits on page: 40
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for WL66559: 2
2026-03-30 12:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-30 12:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9e11e03-0b51-5228-a8d4-38b687612ff7 with scrape type 2
2026-03-30 12:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9e11e03-0b51-5228-a8d4-38b687612ff7 with scrape type 2
2026-03-30 12:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b9e11e03-0b51-5228-a8d4-38b687612ff7, identifier: WL66559
2026-03-30 12:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-30 12:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559
2026-03-30 12:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b9e11e03-0b51-5228-a8d4-38b687612ff7 with identifier: WL66559 to the API
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 114,
'expiration_date': '2026-03-30T15:25:19Z',
'fuel_type': 'petrol',
'id': 'b9e11e03-0b51-5228-a8d4-38b687612ff7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL66559',
'listing': 'auction',
'make': 'EVO',
'model': '4',
'odometer': 28496,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-16',
'seller_name': None,
'title': 'EVO 4 1.6',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Saving data for WL66559: {'auction_closing_time': 1774884319.0, 'created_time': 1774300302.22499, 'last_price_update_time': 1774874160.398341}
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL66559') HTTP/1.1" 204 0
2026-03-30 12:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE21394%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for ZE21394: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF95895%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for JF95895: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM59258%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for KM59258: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT24064%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for DT24064: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: CY97706
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63992%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for VV63992: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10461%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for PM10461: 0
2026-03-30 12:36:00 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-30 12:36:00 [auto1.it] INFO: Scrape type for JN19530: 2
2026-03-30 12:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-30 12:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a021abbc-8973-5ffb-89a0-49e5b59705a9 with scrape type 2
2026-03-30 12:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a021abbc-8973-5ffb-89a0-49e5b59705a9 with scrape type 2
2026-03-30 12:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a021abbc-8973-5ffb-89a0-49e5b59705a9, identifier: JN19530
2026-03-30 12:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-30 12:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530
2026-03-30 12:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a021abbc-8973-5ffb-89a0-49e5b59705a9 with identifier: JN19530 to the API
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:50:42Z',
'fuel_type': 'diesel',
'id': 'a021abbc-8973-5ffb-89a0-49e5b59705a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN19530',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 202249,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-17',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Cool 2WD',
'transmission': 'manual',
'trim': 'Cool 2WD',
'year': 2013}
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Saving data for JN19530: {'auction_closing_time': 1774885842.0, 'created_time': 1772747088.241957, 'last_price_update_time': 1774874161.039904}
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN19530') HTTP/1.1" 204 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: PV13410
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV12122%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for AV12122: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ56254%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for ZZ56254: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for UN43339: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE71737%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for ZE71737: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP75199%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for FP75199: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY46493%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for FY46493: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for AF82865: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for NZ40909: 2
2026-03-30 12:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-30 12:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f2182a-4728-542a-a2bc-47112f06c6b6 with scrape type 2
2026-03-30 12:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f2182a-4728-542a-a2bc-47112f06c6b6 with scrape type 2
2026-03-30 12:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 95f2182a-4728-542a-a2bc-47112f06c6b6, identifier: NZ40909
2026-03-30 12:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-30 12:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909
2026-03-30 12:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 95f2182a-4728-542a-a2bc-47112f06c6b6 with identifier: NZ40909 to the API
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:11:27Z',
'fuel_type': 'petrol',
'id': '95f2182a-4728-542a-a2bc-47112f06c6b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ40909',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 150007,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Saving data for NZ40909: {'auction_closing_time': 1774883487.0, 'created_time': 1774274864.915358, 'last_price_update_time': 1774874161.816874}
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ40909') HTTP/1.1" 204 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG18660%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for LG18660: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for EU82988: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-30 12:36:01 [auto1.it] INFO: Scrape type for DL42775: 0
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-30 12:36:01 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-30 12:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV75261%27 HTTP/1.1" 200 None
2026-03-30 12:36:02 [auto1.it] INFO: Scrape type for GV75261: 0
2026-03-30 12:36:02 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-30 12:36:02 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-30 12:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA75240%27 HTTP/1.1" 200 None
2026-03-30 12:36:02 [auto1.it] INFO: Scrape type for TA75240: 0
2026-03-30 12:36:02 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-30 12:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:03 [auto1.it] INFO: Channel: 24h | Page: 69 | totalHits: 3594 | hits on page: 40
2026-03-30 12:36:03 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-30 12:36:03 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-30 12:36:03 [auto1.it] INFO: Scrape type for XV39349: 2
2026-03-30 12:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-30 12:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd34ef04-e55b-5ce2-8030-511175269cc1 with scrape type 2
2026-03-30 12:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd34ef04-e55b-5ce2-8030-511175269cc1 with scrape type 2
2026-03-30 12:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd34ef04-e55b-5ce2-8030-511175269cc1, identifier: XV39349
2026-03-30 12:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-30 12:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349
2026-03-30 12:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd34ef04-e55b-5ce2-8030-511175269cc1 with identifier: XV39349 to the API
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:58Z',
'fuel_type': 'diesel',
'id': 'cd34ef04-e55b-5ce2-8030-511175269cc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV39349',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 259133,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-30',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2010}
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-30 12:36:03 [auto1.it] INFO: Saving data for XV39349: {'auction_closing_time': 1774883638.0, 'created_time': 1772272849.486534, 'last_price_update_time': 1774874163.85523}
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV39349') HTTP/1.1" 204 0
2026-03-30 12:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:03 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-30 12:36:03 [auto1.it] INFO: Scrape type for CN31542: 0
2026-03-30 12:36:03 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-30 12:36:03 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-30 12:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA89499%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for UA89499: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for WA74830: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS29770%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for FS29770: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD31675%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for TD31675: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV58522%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for DV58522: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69394%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for HD69394: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH03473%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for CH03473: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47770%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for TE47770: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ06099%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for BZ06099: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS52204%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for SS52204: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for KR37794: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for XV25356: 2
2026-03-30 12:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-30 12:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4dd963-4530-5f82-b15c-cc234b7c7fed with scrape type 2
2026-03-30 12:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4dd963-4530-5f82-b15c-cc234b7c7fed with scrape type 2
2026-03-30 12:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4dd963-4530-5f82-b15c-cc234b7c7fed, identifier: XV25356
2026-03-30 12:36:04 [scrapy.extensions.logstats] INFO: Crawled 283 pages (at 8 pages/min), scraped 212 items (at 21 items/min)
2026-03-30 12:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-30 12:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356
2026-03-30 12:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4dd963-4530-5f82-b15c-cc234b7c7fed with identifier: XV25356 to the API
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:19:36Z',
'fuel_type': 'diesel',
'id': '3b4dd963-4530-5f82-b15c-cc234b7c7fed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV25356',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 44259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-06',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2021}
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Saving data for XV25356: {'auction_closing_time': 1774883976.0, 'created_time': 1774602355.476191, 'last_price_update_time': 1774874164.599126}
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV25356') HTTP/1.1" 204 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP20263%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for FP20263: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY70774%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for JY70774: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY39151%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for UY39151: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: TT52453
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for UR73173: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ46449%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for PJ46449: 0
2026-03-30 12:36:04 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX82404%27 HTTP/1.1" 200 None
2026-03-30 12:36:04 [auto1.it] INFO: Scrape type for DX82404: 0
2026-03-30 12:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:36 [auto1.it] INFO: Channel: 24h | Page: 70 | totalHits: 3594 | hits on page: 40
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX25254%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for DX25254: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for MJ86480: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: AR18622
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR18622%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for AR18622: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ72452%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for XZ72452: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for YT66548: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY91699%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for HY91699: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for UM17769: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW61207%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for HW61207: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for JK09197: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA31078%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for CA31078: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS13846%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for JS13846: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for ZN14128: 2
2026-03-30 12:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-30 12:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90720bc8-dd16-555f-8199-27658e3d195e with scrape type 2
2026-03-30 12:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90720bc8-dd16-555f-8199-27658e3d195e with scrape type 2
2026-03-30 12:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90720bc8-dd16-555f-8199-27658e3d195e, identifier: ZN14128
2026-03-30 12:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-30 12:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128
2026-03-30 12:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90720bc8-dd16-555f-8199-27658e3d195e with identifier: ZN14128 to the API
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:59:43Z',
'fuel_type': 'diesel',
'id': '90720bc8-dd16-555f-8199-27658e3d195e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN14128',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 130907,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-24',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Xprime ISG 2WD',
'transmission': 'manual',
'trim': 'Xprime ISG 2WD',
'year': 2019}
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Saving data for ZN14128: {'auction_closing_time': 1774886383.0, 'created_time': 1774602428.848675, 'last_price_update_time': 1774874196.683841}
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZN14128') HTTP/1.1" 204 0
2026-03-30 12:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA45330%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for GA45330: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for UU49973: 0
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-30 12:36:36 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-30 12:36:36 [auto1.it] INFO: Scrape type for EB11724: 2
2026-03-30 12:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-30 12:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e3100f-6160-52ed-8db5-1af0712a88e8 with scrape type 2
2026-03-30 12:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3e3100f-6160-52ed-8db5-1af0712a88e8 with scrape type 2
2026-03-30 12:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3e3100f-6160-52ed-8db5-1af0712a88e8, identifier: EB11724
2026-03-30 12:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-30 12:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724
2026-03-30 12:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3e3100f-6160-52ed-8db5-1af0712a88e8 with identifier: EB11724 to the API
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:31:51Z',
'fuel_type': 'diesel',
'id': 'd3e3100f-6160-52ed-8db5-1af0712a88e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB11724',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 138333,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.it] INFO: Saving data for EB11724: {'auction_closing_time': 1774884711.0, 'created_time': 1773131460.557116, 'last_price_update_time': 1774874197.252339}
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB11724') HTTP/1.1" 204 0
2026-03-30 12:36:37 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-30 12:36:37 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.it] INFO: Scrape type for XP84134: 2
2026-03-30 12:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-30 12:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with scrape type 2
2026-03-30 12:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with scrape type 2
2026-03-30 12:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e, identifier: XP84134
2026-03-30 12:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-30 12:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134
2026-03-30 12:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36f87db7-6bc8-5047-be1e-ae40aa9efb3e with identifier: XP84134 to the API
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:49:43Z',
'fuel_type': 'diesel',
'id': '36f87db7-6bc8-5047-be1e-ae40aa9efb3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP84134',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 150494,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-16',
'seller_name': None,
'title': 'BMW 2er 216d Active Tourer',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.it] INFO: Saving data for XP84134: {'auction_closing_time': 1774885783.0, 'created_time': 1774602450.432194, 'last_price_update_time': 1774874197.699326}
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP84134') HTTP/1.1" 204 0
2026-03-30 12:36:37 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.it] INFO: Scrape type for RV64880: 0
2026-03-30 12:36:37 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-30 12:36:37 [auto1.it] INFO: Scrape type for XH17321: 2
2026-03-30 12:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-30 12:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with scrape type 2
2026-03-30 12:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with scrape type 2
2026-03-30 12:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd, identifier: XH17321
2026-03-30 12:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-30 12:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321
2026-03-30 12:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f53ae3f8-a7ab-57b4-8888-93bd534c3fdd with identifier: XH17321 to the API
2026-03-30 12:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:14:45Z',
'fuel_type': 'petrol',
'id': 'f53ae3f8-a7ab-57b4-8888-93bd534c3fdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH17321',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 66783,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-30',
'seller_name': None,
'title': 'Ford Fusion 1.4 Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2005}
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-30 12:36:38 [auto1.it] INFO: Saving data for XH17321: {'auction_closing_time': 1774883685.0, 'created_time': 1774300053.381202, 'last_price_update_time': 1774874198.153897}
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH17321') HTTP/1.1" 204 0
2026-03-30 12:36:38 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-30 12:36:38 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES64600%27 HTTP/1.1" 200 None
2026-03-30 12:36:38 [auto1.it] INFO: Scrape type for ES64600: 0
2026-03-30 12:36:38 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-30 12:36:38 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-30 12:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:40 [auto1.it] INFO: Channel: 24h | Page: 71 | totalHits: 3594 | hits on page: 40
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV97590%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for KV97590: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: CP04601
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF34891%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for BF34891: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for RX07844: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF46608%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for LF46608: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT26389%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for KT26389: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02604%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for NB02604: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT28559%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for TT28559: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY33245%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for MY33245: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG42211%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for BG42211: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for BK04078: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY46194%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for AY46194: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for VA29565: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for SC91639: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD51522%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for PD51522: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG55667%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for BG55667: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK45797%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for FK45797: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for DS09153: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC52318%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for AC52318: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF37027%27 HTTP/1.1" 200 None
2026-03-30 12:36:40 [auto1.it] INFO: Scrape type for TF37027: 0
2026-03-30 12:36:40 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-30 12:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:36:45 [auto1.it] INFO: Channel: 24h | Page: 72 | totalHits: 3594 | hits on page: 40
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for XY19791: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP30320%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for PP30320: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV74338%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for DV74338: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02542%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for WB02542: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK39445%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for PK39445: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for AD83412: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for SK74491: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL13838%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for HL13838: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ05140%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for TZ05140: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB88786%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for SB88786: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA15195%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for BA15195: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for KN82468: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for XK39914: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for PT72554: 0
2026-03-30 12:36:45 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Scrape type for SK80279: 2
2026-03-30 12:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-30 12:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 351c6ef1-92a2-5346-8a16-9402044bdd62 with scrape type 2
2026-03-30 12:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 351c6ef1-92a2-5346-8a16-9402044bdd62 with scrape type 2
2026-03-30 12:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 351c6ef1-92a2-5346-8a16-9402044bdd62, identifier: SK80279
2026-03-30 12:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-30 12:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279
2026-03-30 12:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 351c6ef1-92a2-5346-8a16-9402044bdd62 with identifier: SK80279 to the API
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:44:57Z',
'fuel_type': 'diesel',
'id': '351c6ef1-92a2-5346-8a16-9402044bdd62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK80279',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 86116,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-06',
'seller_name': None,
'title': 'Land Rover Evoque D180 Mild-Hybrid R-dynamic SE',
'transmission': 'automatic',
'trim': 'R-dynamic SE',
'year': 2019}
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-30 12:36:45 [auto1.it] INFO: Saving data for SK80279: {'auction_closing_time': 1774885497.0, 'created_time': 1774274817.5766, 'last_price_update_time': 1774874205.976829}
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SK80279') HTTP/1.1" 204 0
2026-03-30 12:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:36:46 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-30 12:36:46 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-30 12:36:46 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-30 12:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30919%27 HTTP/1.1" 200 None
2026-03-30 12:36:46 [auto1.it] INFO: Scrape type for TP30919: 0
2026-03-30 12:36:46 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-30 12:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:02 [auto1.it] INFO: Channel: 24h | Page: 73 | totalHits: 3594 | hits on page: 40
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.it] INFO: Scrape type for EE91281: 0
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW78911%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.it] INFO: Scrape type for KW78911: 0
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-30 12:37:02 [auto1.it] INFO: Scrape type for AJ45475: 0
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-30 12:37:02 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-30 12:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for RA46767: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM28799%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for GM28799: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for NP81459: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for KD77242: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ90619%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for DZ90619: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT34353%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for BT34353: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67651%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for EV67651: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT31033%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for RT31033: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for GY24745: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for DA14696: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for KR27714: 2
2026-03-30 12:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-30 12:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537228b3-fa25-5f9e-b168-c918b03315f9 with scrape type 2
2026-03-30 12:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 537228b3-fa25-5f9e-b168-c918b03315f9 with scrape type 2
2026-03-30 12:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 537228b3-fa25-5f9e-b168-c918b03315f9, identifier: KR27714
2026-03-30 12:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-30 12:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714
2026-03-30 12:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 537228b3-fa25-5f9e-b168-c918b03315f9 with identifier: KR27714 to the API
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:14:36Z',
'fuel_type': 'diesel',
'id': '537228b3-fa25-5f9e-b168-c918b03315f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR27714',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 102579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-22',
'seller_name': None,
'title': 'Opel Meriva 1.3 CDTI Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2012}
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Saving data for KR27714: {'auction_closing_time': 1774883676.0, 'created_time': 1772784614.419114, 'last_price_update_time': 1774874223.631122}
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KR27714') HTTP/1.1" 204 0
2026-03-30 12:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX71767%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for BX71767: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY71286%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for NY71286: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: LN65398
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN65398%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for LN65398: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF25963%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for FF25963: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT36373%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for NT36373: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for MK89859: 0
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-30 12:37:03 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-30 12:37:03 [auto1.it] INFO: Scrape type for EU08042: 2
2026-03-30 12:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-30 12:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with scrape type 2
2026-03-30 12:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with scrape type 2
2026-03-30 12:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c, identifier: EU08042
2026-03-30 12:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-30 12:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042
2026-03-30 12:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39cb64be-3f9f-515c-913f-3c84dcfa7f9c with identifier: EU08042 to the API
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:14:10Z',
'fuel_type': 'petrol',
'id': '39cb64be-3f9f-515c-913f-3c84dcfa7f9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU08042',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 129731,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-26',
'seller_name': None,
'title': 'Fiat Punto 1.2 Street',
'transmission': 'manual',
'trim': 'Street',
'year': 2018}
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-30 12:37:04 [auto1.it] INFO: Saving data for EU08042: {'auction_closing_time': 1774883650.0, 'created_time': 1774602434.470392, 'last_price_update_time': 1774874224.274052}
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU08042') HTTP/1.1" 204 0
2026-03-30 12:37:04 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT73216%27 HTTP/1.1" 200 None
2026-03-30 12:37:04 [auto1.it] INFO: Scrape type for TT73216: 0
2026-03-30 12:37:04 [scrapy.extensions.logstats] INFO: Crawled 287 pages (at 4 pages/min), scraped 220 items (at 8 items/min)
2026-03-30 12:37:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:05 [auto1.it] INFO: Channel: 24h | Page: 74 | totalHits: 3594 | hits on page: 40
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Scrape type for RT93241: 2
2026-03-30 12:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-30 12:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66af43d4-9a9e-5bc9-8f81-38899ce7274d with scrape type 2
2026-03-30 12:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66af43d4-9a9e-5bc9-8f81-38899ce7274d with scrape type 2
2026-03-30 12:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66af43d4-9a9e-5bc9-8f81-38899ce7274d, identifier: RT93241
2026-03-30 12:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-30 12:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241
2026-03-30 12:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66af43d4-9a9e-5bc9-8f81-38899ce7274d with identifier: RT93241 to the API
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:39:18Z',
'fuel_type': 'diesel',
'id': '66af43d4-9a9e-5bc9-8f81-38899ce7274d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT93241',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 147240,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Audi Q2 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Saving data for RT93241: {'auction_closing_time': 1774885158.0, 'created_time': 1774602436.752333, 'last_price_update_time': 1774874225.847312}
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT93241') HTTP/1.1" 204 0
2026-03-30 12:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM50235%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Scrape type for DM50235: 0
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Scrape type for WL39771: 0
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Scrape type for ER28485: 0
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP47784%27 HTTP/1.1" 200 None
2026-03-30 12:37:05 [auto1.it] INFO: Scrape type for AP47784: 0
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-30 12:37:05 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-30 12:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS74594%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for SS74594: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for YR57836: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS88689%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for VS88689: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB10041%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for VB10041: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for MH63316: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: WG36727
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for FG22478: 2
2026-03-30 12:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-30 12:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba69047d-8b87-5ff9-a232-8eb082429c50 with scrape type 2
2026-03-30 12:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba69047d-8b87-5ff9-a232-8eb082429c50 with scrape type 2
2026-03-30 12:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba69047d-8b87-5ff9-a232-8eb082429c50, identifier: FG22478
2026-03-30 12:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-30 12:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478
2026-03-30 12:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba69047d-8b87-5ff9-a232-8eb082429c50 with identifier: FG22478 to the API
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:48:37Z',
'fuel_type': 'diesel',
'id': 'ba69047d-8b87-5ff9-a232-8eb082429c50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG22478',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 175367,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Saving data for FG22478: {'auction_closing_time': 1774885717.0, 'created_time': 1772103851.508522, 'last_price_update_time': 1774874226.486437}
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FG22478') HTTP/1.1" 204 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD53627%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for FD53627: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE69721%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for UE69721: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for NY14439: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for XH35372: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA25945%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for FA25945: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: ZW88781
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW88781%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for ZW88781: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for RC55633: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL56801%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for ZL56801: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN89798%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for FN89798: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU32516%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for ZU32516: 0
2026-03-30 12:37:06 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-30 12:37:06 [auto1.it] INFO: Scrape type for YY37168: 2
2026-03-30 12:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-30 12:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6725802a-3980-53d9-a51e-2c8b76fcfc53 with scrape type 2
2026-03-30 12:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6725802a-3980-53d9-a51e-2c8b76fcfc53 with scrape type 2
2026-03-30 12:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6725802a-3980-53d9-a51e-2c8b76fcfc53, identifier: YY37168
2026-03-30 12:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-30 12:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168
2026-03-30 12:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6725802a-3980-53d9-a51e-2c8b76fcfc53 with identifier: YY37168 to the API
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:50:57Z',
'fuel_type': 'petrol',
'id': '6725802a-3980-53d9-a51e-2c8b76fcfc53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY37168',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 226131,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-29',
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-30 12:37:07 [auto1.it] INFO: Saving data for YY37168: {'auction_closing_time': 1774885857.0, 'created_time': 1774602442.2122, 'last_price_update_time': 1774874227.214846}
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YY37168') HTTP/1.1" 204 0
2026-03-30 12:37:07 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-30 12:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:08 [auto1.it] INFO: Channel: 24h | Page: 75 | totalHits: 3594 | hits on page: 40
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW61851%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for PW61851: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN84990%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for PN84990: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for EV28185: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for HW99269: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK96047%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for EK96047: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for HW38972: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for CT94493: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW45727%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for XW45727: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ96008%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for WJ96008: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99644%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for EA99644: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR80545%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for LR80545: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for NH43496: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST06974%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for ST06974: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA38395%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for YA38395: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for AF86061: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for HH71659: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD36680%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for JD36680: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for XW11581: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for FV08764: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR85251%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for BR85251: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK76451%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for HK76451: 0
2026-03-30 12:37:08 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56549%27 HTTP/1.1" 200 None
2026-03-30 12:37:08 [auto1.it] INFO: Scrape type for MJ56549: 0
2026-03-30 12:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:09 [auto1.it] INFO: Channel: 24h | Page: 76 | totalHits: 3594 | hits on page: 40
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT53480%27 HTTP/1.1" 200 None
2026-03-30 12:37:09 [auto1.it] INFO: Scrape type for GT53480: 0
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-30 12:37:09 [auto1.it] INFO: Scrape type for RF78298: 0
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN60691%27 HTTP/1.1" 200 None
2026-03-30 12:37:09 [auto1.it] INFO: Scrape type for CN60691: 0
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: ZJ39070
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-30 12:37:09 [auto1.it] INFO: Scrape type for NF08896: 0
2026-03-30 12:37:09 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ05187%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for AZ05187: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for VY80184: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX04626%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for PX04626: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for ER97620: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43445%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for HS43445: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH88339%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for TH88339: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for YW53472: 2
2026-03-30 12:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-30 12:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c87ba82-2f90-517f-90c2-3889c035945b with scrape type 2
2026-03-30 12:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c87ba82-2f90-517f-90c2-3889c035945b with scrape type 2
2026-03-30 12:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c87ba82-2f90-517f-90c2-3889c035945b, identifier: YW53472
2026-03-30 12:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-30 12:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472
2026-03-30 12:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c87ba82-2f90-517f-90c2-3889c035945b with identifier: YW53472 to the API
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:25:35Z',
'fuel_type': 'diesel',
'id': '2c87ba82-2f90-517f-90c2-3889c035945b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW53472',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 223174,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-17',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Saving data for YW53472: {'auction_closing_time': 1774884335.0, 'created_time': 1772176809.531559, 'last_price_update_time': 1774874230.576254}
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW53472') HTTP/1.1" 204 0
2026-03-30 12:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL31507%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for DL31507: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH25620%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for PH25620: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ47839%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for GZ47839: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for AR03634: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78357%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for XE78357: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02319%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for TL02319: 0
2026-03-30 12:37:10 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-30 12:37:10 [auto1.it] INFO: Scrape type for BW07837: 2
2026-03-30 12:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-30 12:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c2dd93-266e-5570-af62-92bf84ecab70 with scrape type 2
2026-03-30 12:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c2dd93-266e-5570-af62-92bf84ecab70 with scrape type 2
2026-03-30 12:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20c2dd93-266e-5570-af62-92bf84ecab70, identifier: BW07837
2026-03-30 12:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-30 12:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837
2026-03-30 12:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20c2dd93-266e-5570-af62-92bf84ecab70 with identifier: BW07837 to the API
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:20:35Z',
'fuel_type': 'diesel',
'id': '20c2dd93-266e-5570-af62-92bf84ecab70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW07837',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 158155,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-30',
'seller_name': None,
'title': 'Fiat Panda 1.3 M-Jet Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2017}
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Saving data for BW07837: {'auction_closing_time': 1774884035.0, 'created_time': 1774602441.361816, 'last_price_update_time': 1774874231.558489}
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BW07837') HTTP/1.1" 204 0
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: FE63733
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE63733%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Scrape type for FE63733: 0
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: AK49270
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: TP02469
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: UC14598
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC14598%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Scrape type for UC14598: 0
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: RV10689
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: YV66151
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: NT18683
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: VH18457
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH18457%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Scrape type for VH18457: 0
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: PM85940
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM85940%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Scrape type for PM85940: 0
2026-03-30 12:37:11 [auto1.it] INFO: Found listing with ID: UK60459
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK60459%27 HTTP/1.1" 200 None
2026-03-30 12:37:11 [auto1.it] INFO: Scrape type for UK60459: 0
2026-03-30 12:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:19 [auto1.it] INFO: Channel: 24h | Page: 77 | totalHits: 3594 | hits on page: 40
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: XJ25634
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: TS00967
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: CZ11807
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11807%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for CZ11807: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: HY82012
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82012%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for HY82012: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: MY80647
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: BC50392
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: YD02421
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD02421%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for YD02421: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: RK76685
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: HJ04810
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: MR30902
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: JZ43112
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43112%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for JZ43112: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: EF18991
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: PZ93263
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: YD31077
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: WK47884
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK47884%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for WK47884: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: GR46256
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR46256%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for GR46256: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: KR62960
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: BP72871
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP72871%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for BP72871: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: MN05358
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN05358%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for MN05358: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: NX49735
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: RM50163
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: TH60548
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH60548%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for TH60548: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: JM95977
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: SC57434
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57434%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for SC57434: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: WM09394
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: NH87827
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: EP52133
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP52133%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for EP52133: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: PY38952
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY38952%27 HTTP/1.1" 200 None
2026-03-30 12:37:19 [auto1.it] INFO: Scrape type for PY38952: 0
2026-03-30 12:37:19 [auto1.it] INFO: Found listing with ID: GZ68257
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ68257%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for GZ68257: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: CG38373
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG38373%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for CG38373: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: KN28324
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN28324%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for KN28324: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: SV68471
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: BH87833
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH87833%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for BH87833: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: NE29040
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE29040%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for NE29040: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: RK99012
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK99012%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for RK99012: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: NC22560
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC22560%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for NC22560: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: FC56913
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: VB76236
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB76236%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for VB76236: 0
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: TJ16144
2026-03-30 12:37:20 [auto1.it] INFO: Found listing with ID: MP38802
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP38802%27 HTTP/1.1" 200 None
2026-03-30 12:37:20 [auto1.it] INFO: Scrape type for MP38802: 0
2026-03-30 12:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:40 [auto1.it] INFO: Channel: 24h | Page: 78 | totalHits: 3597 | hits on page: 40
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: VB76236
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB76236%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for VB76236: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: TJ16144
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: MP38802
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP38802%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for MP38802: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: KV55907
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: BZ51177
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ51177%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for BZ51177: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: CY56164
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY56164%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for CY56164: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: TB63135
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB63135%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for TB63135: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: ZK39903
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK39903%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for ZK39903: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: KZ13497
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: YX84472
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX84472%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for YX84472: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: AT73331
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: NW39959
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: YK98276
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK98276%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for YK98276: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: CJ64567
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: FK78904
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK78904%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for FK78904: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: JC35817
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC35817%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for JC35817: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: MC76570
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC76570%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for MC76570: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: ZC44432
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: BB49648
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: NC13614
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC13614%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for NC13614: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: GJ99640
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: TT70902
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT70902%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for TT70902: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: ZG26295
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG26295%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for ZG26295: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: CT59426
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT59426%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for CT59426: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: GK49763
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: EN63218
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN63218%27 HTTP/1.1" 200 None
2026-03-30 12:37:40 [auto1.it] INFO: Scrape type for EN63218: 0
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: NM61203
2026-03-30 12:37:40 [auto1.it] INFO: Found listing with ID: PV47203
2026-03-30 12:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV47203%27 HTTP/1.1" 200 None
2026-03-30 12:37:41 [auto1.it] INFO: Scrape type for PV47203: 0
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: YE33932
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: JR36012
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: RS27725
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS27725%27 HTTP/1.1" 200 None
2026-03-30 12:37:41 [auto1.it] INFO: Scrape type for RS27725: 0
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: XP44684
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP44684%27 HTTP/1.1" 200 None
2026-03-30 12:37:41 [auto1.it] INFO: Scrape type for XP44684: 0
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: ML45383
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML45383%27 HTTP/1.1" 200 None
2026-03-30 12:37:41 [auto1.it] INFO: Scrape type for ML45383: 0
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: LJ23422
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: YM04373
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: MZ65778
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: SB59466
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: BV17272
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: FE93281
2026-03-30 12:37:41 [auto1.it] INFO: Found listing with ID: EG33732
2026-03-30 12:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:37:52 [auto1.it] INFO: Channel: 24h | Page: 79 | totalHits: 3597 | hits on page: 40
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: TR09676
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: SX65477
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX65477%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for SX65477: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: DA98342
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: HB00898
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: NF72135
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF72135%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for NF72135: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: XS00387
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS00387%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for XS00387: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: AR49211
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: MD59623
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD59623%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for MD59623: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: RN27083
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN27083%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for RN27083: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: EZ67132
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: RG18197
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: AW19697
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW19697%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for AW19697: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: UJ83864
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: XM71615
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71615%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for XM71615: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: RR79025
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: AG42346
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: AS99130
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: RH79013
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: JL18468
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: FP31020
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP31020%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for FP31020: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: AV18402
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: ZF99216
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF99216%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for ZF99216: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: WF32010
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: XH74376
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: EC03156
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: PD98498
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD98498%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for PD98498: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: HJ07688
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ07688%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for HJ07688: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: FF80511
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: UB92069
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: GU46238
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU46238%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for GU46238: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: GS36896
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS36896%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for GS36896: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: DK49031
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK49031%27 HTTP/1.1" 200 None
2026-03-30 12:37:52 [auto1.it] INFO: Scrape type for DK49031: 0
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: MN68562
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: RR38006
2026-03-30 12:37:52 [auto1.it] INFO: Found listing with ID: UW74676
2026-03-30 12:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW74676%27 HTTP/1.1" 200 None
2026-03-30 12:37:53 [auto1.it] INFO: Scrape type for UW74676: 0
2026-03-30 12:37:53 [auto1.it] INFO: Found listing with ID: JZ66909
2026-03-30 12:37:53 [auto1.it] INFO: Found listing with ID: EW77307
2026-03-30 12:37:53 [auto1.it] INFO: Found listing with ID: HJ48011
2026-03-30 12:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ48011%27 HTTP/1.1" 200 None
2026-03-30 12:37:53 [auto1.it] INFO: Scrape type for HJ48011: 0
2026-03-30 12:37:53 [auto1.it] INFO: Found listing with ID: PJ71432
2026-03-30 12:37:53 [auto1.it] INFO: Found listing with ID: HJ37635
2026-03-30 12:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:01 [auto1.it] INFO: Channel: 24h | Page: 80 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: UM30654
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: HY25299
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: RG33241
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: ZT77518
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT77518%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for ZT77518: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: KS29368
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS29368%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for KS29368: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: XS70804
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: EL95895
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: XP33889
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP33889%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for XP33889: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: BS70853
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS70853%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for BS70853: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: PP81137
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP81137%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for PP81137: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: AB11915
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: YT31818
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: LK77946
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK77946%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for LK77946: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: CV06620
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV06620%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for CV06620: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: CP91888
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: AT88859
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: WR49596
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: UT72595
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: WU25072
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU25072%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for WU25072: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: XP46027
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP46027%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for XP46027: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: ZS74487
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS74487%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for ZS74487: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: FP84024
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP84024%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for FP84024: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: HA91371
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA91371%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for HA91371: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: ZT94310
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT94310%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for ZT94310: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: YB21046
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB21046%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for YB21046: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: GY17675
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY17675%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for GY17675: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: HR28952
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR28952%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for HR28952: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: CL50179
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL50179%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for CL50179: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: AV05178
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: ZS11268
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: MR54744
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: VD19319
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: VR66407
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: MH80667
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: SH27035
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH27035%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for SH27035: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: AT94230
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT94230%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for AT94230: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: VZ01162
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ01162%27 HTTP/1.1" 200 None
2026-03-30 12:38:01 [auto1.it] INFO: Scrape type for VZ01162: 0
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: KL53293
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: PC10788
2026-03-30 12:38:01 [auto1.it] INFO: Found listing with ID: UK65211
2026-03-30 12:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:04 [auto1.it] INFO: Channel: 24h | Page: 81 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: JP68462
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP68462%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for JP68462: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: PW02213
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW02213%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for PW02213: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: HK83461
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK83461%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for HK83461: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: YY73995
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY73995%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for YY73995: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: SA64006
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA64006%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for SA64006: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: CL59289
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL59289%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for CL59289: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: MM92729
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: XG56779
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: PN94511
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94511%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for PN94511: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: SP64220
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: DC19091
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19091%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for DC19091: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: CE88334
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: FP92305
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: WH54274
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: YA71285
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: ZZ46220
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46220%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for ZZ46220: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: CW38322
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW38322%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for CW38322: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: LX63173
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: KV28875
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV28875%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for KV28875: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: RA59977
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA59977%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for RA59977: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: NF25875
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: WJ04614
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ04614%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for WJ04614: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: KZ65568
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ65568%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for KZ65568: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: GJ44194
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: JK37550
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK37550%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for JK37550: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: ZJ54266
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ54266%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for ZJ54266: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: TU97067
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU97067%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for TU97067: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: NG25648
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: BR40244
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR40244%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for BR40244: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: DN16039
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: AV77078
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: WA78117
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA78117%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for WA78117: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: KJ64759
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: DV92182
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV92182%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for DV92182: 0
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-30 12:38:04 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-30 12:38:04 [auto1.it] INFO: Scrape type for SN56705: 2
2026-03-30 12:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-30 12:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe3a245-e334-53de-bcfa-d451fd57632f with scrape type 2
2026-03-30 12:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe3a245-e334-53de-bcfa-d451fd57632f with scrape type 2
2026-03-30 12:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9fe3a245-e334-53de-bcfa-d451fd57632f, identifier: SN56705
2026-03-30 12:38:05 [scrapy.extensions.logstats] INFO: Crawled 295 pages (at 8 pages/min), scraped 225 items (at 5 items/min)
2026-03-30 12:38:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-30 12:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705
2026-03-30 12:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9fe3a245-e334-53de-bcfa-d451fd57632f with identifier: SN56705 to the API
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:51:43Z',
'fuel_type': 'hybrid',
'id': '9fe3a245-e334-53de-bcfa-d451fd57632f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN56705',
'listing': 'auction',
'make': 'Lexus',
'model': 'RX-Serie',
'odometer': 129187,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-12',
'seller_name': None,
'title': 'Lexus RX-Serie RX 450h Executive AWD',
'transmission': 'automatic',
'trim': 'Executive AWD',
'year': 2019}
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-30 12:38:05 [auto1.it] INFO: Saving data for SN56705: {'auction_closing_time': 1774885903.0, 'created_time': 1774699529.974112, 'last_price_update_time': 1774874285.648656}
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN56705') HTTP/1.1" 204 0
2026-03-30 12:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:05 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-30 12:38:05 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-30 12:38:05 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-30 12:38:05 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-30 12:38:05 [auto1.it] INFO: Scrape type for CZ11346: 2
2026-03-30 12:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-30 12:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5beb21-5654-503b-a914-2b1cae75b99a with scrape type 2
2026-03-30 12:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5beb21-5654-503b-a914-2b1cae75b99a with scrape type 2
2026-03-30 12:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e5beb21-5654-503b-a914-2b1cae75b99a, identifier: CZ11346
2026-03-30 12:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-30 12:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346
2026-03-30 12:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e5beb21-5654-503b-a914-2b1cae75b99a with identifier: CZ11346 to the API
2026-03-30 12:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:34Z',
'fuel_type': 'diesel',
'id': '3e5beb21-5654-503b-a914-2b1cae75b99a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ11346',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 161122,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-14',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-30 12:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-30 12:38:06 [auto1.it] INFO: Saving data for CZ11346: {'auction_closing_time': 1774884274.0, 'created_time': 1774343220.210279, 'last_price_update_time': 1774874286.184519}
2026-03-30 12:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ11346') HTTP/1.1" 204 0
2026-03-30 12:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:08 [auto1.it] INFO: Channel: 24h | Page: 82 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:08 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-30 12:38:08 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-30 12:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-30 12:38:08 [auto1.it] INFO: Scrape type for AW40388: 2
2026-03-30 12:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-30 12:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80460fdc-6272-5d55-8b9d-e43980ef5352 with scrape type 2
2026-03-30 12:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80460fdc-6272-5d55-8b9d-e43980ef5352 with scrape type 2
2026-03-30 12:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80460fdc-6272-5d55-8b9d-e43980ef5352, identifier: AW40388
2026-03-30 12:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-30 12:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388
2026-03-30 12:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80460fdc-6272-5d55-8b9d-e43980ef5352 with identifier: AW40388 to the API
2026-03-30 12:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:42:20Z',
'fuel_type': 'petrol',
'id': '80460fdc-6272-5d55-8b9d-e43980ef5352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW40388',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 80400,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-17',
'seller_name': None,
'title': 'Hyundai i20 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Saving data for AW40388: {'auction_closing_time': 1774885340.0, 'created_time': 1773134307.451154, 'last_price_update_time': 1774874289.136358}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW40388') HTTP/1.1" 204 0
2026-03-30 12:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:09 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-30 12:38:09 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Scrape type for DE71304: 2
2026-03-30 12:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-30 12:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fc66b56-8239-5938-8e7b-f902a1605208 with scrape type 2
2026-03-30 12:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fc66b56-8239-5938-8e7b-f902a1605208 with scrape type 2
2026-03-30 12:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5fc66b56-8239-5938-8e7b-f902a1605208, identifier: DE71304
2026-03-30 12:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-30 12:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304
2026-03-30 12:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5fc66b56-8239-5938-8e7b-f902a1605208 with identifier: DE71304 to the API
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:08:04Z',
'fuel_type': 'diesel',
'id': '5fc66b56-8239-5938-8e7b-f902a1605208',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE71304',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 305596,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-21',
'seller_name': None,
'title': 'Volvo V60 1.6 D Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2014}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Saving data for DE71304: {'auction_closing_time': 1774883284.0, 'created_time': 1774343231.181223, 'last_price_update_time': 1774874289.520064}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE71304') HTTP/1.1" 204 0
2026-03-30 12:38:09 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Scrape type for LA00570: 2
2026-03-30 12:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-30 12:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75f202e-9b63-5ec9-a643-e77ed3755145 with scrape type 2
2026-03-30 12:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75f202e-9b63-5ec9-a643-e77ed3755145 with scrape type 2
2026-03-30 12:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b75f202e-9b63-5ec9-a643-e77ed3755145, identifier: LA00570
2026-03-30 12:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-30 12:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570
2026-03-30 12:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b75f202e-9b63-5ec9-a643-e77ed3755145 with identifier: LA00570 to the API
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:12:39Z',
'fuel_type': 'diesel',
'id': 'b75f202e-9b63-5ec9-a643-e77ed3755145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA00570',
'listing': 'auction',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 277646,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-27',
'seller_name': None,
'title': 'Jeep Cherokee 2.0 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2014}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Saving data for LA00570: {'auction_closing_time': 1774883559.0, 'created_time': 1774699522.986735, 'last_price_update_time': 1774874289.909653}
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LA00570') HTTP/1.1" 204 0
2026-03-30 12:38:09 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-30 12:38:09 [auto1.it] INFO: Scrape type for ST97650: 2
2026-03-30 12:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-30 12:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with scrape type 2
2026-03-30 12:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with scrape type 2
2026-03-30 12:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5f9bc66-64df-5ac5-9e3d-f54ea593e770, identifier: ST97650
2026-03-30 12:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-30 12:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650
2026-03-30 12:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5f9bc66-64df-5ac5-9e3d-f54ea593e770 with identifier: ST97650 to the API
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:59:58Z',
'fuel_type': 'diesel',
'id': 'e5f9bc66-64df-5ac5-9e3d-f54ea593e770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST97650',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 205873,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-10',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-30 12:38:10 [auto1.it] INFO: Saving data for ST97650: {'auction_closing_time': 1774886398.0, 'created_time': 1773241902.921045, 'last_price_update_time': 1774874290.39123}
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ST97650') HTTP/1.1" 204 0
2026-03-30 12:38:10 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-30 12:38:10 [auto1.it] INFO: Scrape type for CD54959: 2
2026-03-30 12:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-30 12:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with scrape type 2
2026-03-30 12:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with scrape type 2
2026-03-30 12:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5, identifier: CD54959
2026-03-30 12:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-30 12:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959
2026-03-30 12:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5 with identifier: CD54959 to the API
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:33:25Z',
'fuel_type': 'diesel',
'id': 'b4f7e7ed-7a10-5e68-bebd-36b5adf5d8f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD54959',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 159839,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-11',
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Cosmo ecoFlex',
'transmission': 'manual',
'trim': 'Cosmo ecoFlex',
'year': 2015}
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-30 12:38:10 [auto1.it] INFO: Saving data for CD54959: {'auction_closing_time': 1774884805.0, 'created_time': 1773824773.404386, 'last_price_update_time': 1774874290.896043}
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD54959') HTTP/1.1" 204 0
2026-03-30 12:38:11 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-30 12:38:11 [auto1.it] INFO: Scrape type for ZH08694: 2
2026-03-30 12:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-30 12:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with scrape type 2
2026-03-30 12:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with scrape type 2
2026-03-30 12:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 162bacd6-cf45-5c7b-b8fb-2349c890dad3, identifier: ZH08694
2026-03-30 12:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-30 12:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694
2026-03-30 12:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 162bacd6-cf45-5c7b-b8fb-2349c890dad3 with identifier: ZH08694 to the API
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-30T15:07:08Z',
'fuel_type': 'diesel',
'id': '162bacd6-cf45-5c7b-b8fb-2349c890dad3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH08694',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 121243,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-04',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 dCi Diesel SL Trotamundos',
'transmission': 'manual',
'trim': 'SL Trotamundos',
'year': 2017}
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-30 12:38:11 [auto1.it] INFO: Saving data for ZH08694: {'auction_closing_time': 1774883228.0, 'created_time': 1774699570.135768, 'last_price_update_time': 1774874291.544587}
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH08694') HTTP/1.1" 204 0
2026-03-30 12:38:11 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-30 12:38:11 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-30 12:38:11 [auto1.it] INFO: Scrape type for RT10721: 2
2026-03-30 12:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-30 12:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772039df-faed-5833-bbce-5cf1a5434400 with scrape type 2
2026-03-30 12:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772039df-faed-5833-bbce-5cf1a5434400 with scrape type 2
2026-03-30 12:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 772039df-faed-5833-bbce-5cf1a5434400, identifier: RT10721
2026-03-30 12:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-30 12:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721
2026-03-30 12:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 772039df-faed-5833-bbce-5cf1a5434400 with identifier: RT10721 to the API
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:18:36Z',
'fuel_type': 'diesel',
'id': '772039df-faed-5833-bbce-5cf1a5434400',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT10721',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 401753,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-20',
'seller_name': None,
'title': 'Volvo XC60 2.0 D4 Kinetic 2WD',
'transmission': 'manual',
'trim': 'Kinetic 2WD',
'year': 2015}
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-30 12:38:11 [auto1.it] INFO: Saving data for RT10721: {'auction_closing_time': 1774883916.0, 'created_time': 1774699533.061962, 'last_price_update_time': 1774874291.953139}
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT10721') HTTP/1.1" 204 0
2026-03-30 12:38:11 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-30 12:38:11 [auto1.it] INFO: Scrape type for XL68174: 2
2026-03-30 12:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-30 12:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with scrape type 2
2026-03-30 12:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with scrape type 2
2026-03-30 12:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9, identifier: XL68174
2026-03-30 12:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-30 12:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174
2026-03-30 12:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0eb50f97-3888-55ed-a6c5-16cf0b0679e9 with identifier: XL68174 to the API
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 354,
'expiration_date': '2026-03-30T15:35:01Z',
'fuel_type': 'petrol',
'id': '0eb50f97-3888-55ed-a6c5-16cf0b0679e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL68174',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 123890,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-30',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-30 12:38:12 [auto1.it] INFO: Saving data for XL68174: {'auction_closing_time': 1774884901.0, 'created_time': 1773836628.120266, 'last_price_update_time': 1774874292.654125}
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XL68174') HTTP/1.1" 204 0
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ77239%27 HTTP/1.1" 200 None
2026-03-30 12:38:12 [auto1.it] INFO: Scrape type for CJ77239: 0
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT82313%27 HTTP/1.1" 200 None
2026-03-30 12:38:12 [auto1.it] INFO: Scrape type for BT82313: 0
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-30 12:38:12 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-30 12:38:12 [auto1.it] INFO: Scrape type for WB58416: 2
2026-03-30 12:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-30 12:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74914a42-d1b1-50af-9fad-344cece9172a with scrape type 2
2026-03-30 12:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74914a42-d1b1-50af-9fad-344cece9172a with scrape type 2
2026-03-30 12:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 74914a42-d1b1-50af-9fad-344cece9172a, identifier: WB58416
2026-03-30 12:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-30 12:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416
2026-03-30 12:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 74914a42-d1b1-50af-9fad-344cece9172a with identifier: WB58416 to the API
2026-03-30 12:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:14Z',
'fuel_type': 'diesel',
'id': '74914a42-d1b1-50af-9fad-344cece9172a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB58416',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 167570,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2018}
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-30 12:38:13 [auto1.it] INFO: Saving data for WB58416: {'auction_closing_time': 1774884374.0, 'created_time': 1773129491.141896, 'last_price_update_time': 1774874293.465697}
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB58416') HTTP/1.1" 204 0
2026-03-30 12:38:13 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-30 12:38:13 [auto1.it] INFO: Scrape type for CS61296: 2
2026-03-30 12:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-30 12:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515399f1-c951-5577-88f0-8b40f453c68e with scrape type 2
2026-03-30 12:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515399f1-c951-5577-88f0-8b40f453c68e with scrape type 2
2026-03-30 12:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 515399f1-c951-5577-88f0-8b40f453c68e, identifier: CS61296
2026-03-30 12:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-30 12:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296
2026-03-30 12:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 515399f1-c951-5577-88f0-8b40f453c68e with identifier: CS61296 to the API
2026-03-30 12:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'diesel',
'id': '515399f1-c951-5577-88f0-8b40f453c68e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS61296',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 126849,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-29',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-30 12:38:14 [auto1.it] INFO: Saving data for CS61296: {'auction_closing_time': 1774885907.0, 'created_time': 1774699573.743567, 'last_price_update_time': 1774874294.137367}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CS61296') HTTP/1.1" 204 0
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-30 12:38:14 [auto1.it] INFO: Scrape type for KT14926: 2
2026-03-30 12:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-30 12:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51a8a2c-1974-5620-a637-684ee20c2e01 with scrape type 2
2026-03-30 12:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51a8a2c-1974-5620-a637-684ee20c2e01 with scrape type 2
2026-03-30 12:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b51a8a2c-1974-5620-a637-684ee20c2e01, identifier: KT14926
2026-03-30 12:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-30 12:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926
2026-03-30 12:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b51a8a2c-1974-5620-a637-684ee20c2e01 with identifier: KT14926 to the API
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'diesel',
'id': 'b51a8a2c-1974-5620-a637-684ee20c2e01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT14926',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 122611,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-04-21',
'seller_name': None,
'title': 'Ford Focus 1.8 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2004}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-30 12:38:14 [auto1.it] INFO: Saving data for KT14926: {'auction_closing_time': 1774884733.0, 'created_time': 1774699555.942708, 'last_price_update_time': 1774874294.563374}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT14926') HTTP/1.1" 204 0
2026-03-30 12:38:14 [auto1.it] INFO: Channel: 24h | Page: 83 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:14 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-30 12:38:14 [auto1.it] INFO: Scrape type for SD18580: 2
2026-03-30 12:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-30 12:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8e44a06-a18c-5859-9c07-3c21cfc20b5b with scrape type 2
2026-03-30 12:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8e44a06-a18c-5859-9c07-3c21cfc20b5b with scrape type 2
2026-03-30 12:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8e44a06-a18c-5859-9c07-3c21cfc20b5b, identifier: SD18580
2026-03-30 12:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-30 12:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580
2026-03-30 12:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8e44a06-a18c-5859-9c07-3c21cfc20b5b with identifier: SD18580 to the API
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:06:27Z',
'fuel_type': 'diesel',
'id': 'd8e44a06-a18c-5859-9c07-3c21cfc20b5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD18580',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 197004,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-04',
'seller_name': None,
'title': 'Opel Mokka 1.7 CDTI Ego ecoFlex',
'transmission': 'manual',
'trim': 'Ego ecoFlex',
'year': 2014}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-30 12:38:14 [auto1.it] INFO: Saving data for SD18580: {'auction_closing_time': 1774883187.0, 'created_time': 1773867971.232816, 'last_price_update_time': 1774874294.991893}
2026-03-30 12:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD18580') HTTP/1.1" 204 0
2026-03-30 12:38:15 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-30 12:38:15 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-30 12:38:15 [auto1.it] INFO: Scrape type for FR55532: 2
2026-03-30 12:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-30 12:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1540861-55d8-5622-83cc-65661a4f82a9 with scrape type 2
2026-03-30 12:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1540861-55d8-5622-83cc-65661a4f82a9 with scrape type 2
2026-03-30 12:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f1540861-55d8-5622-83cc-65661a4f82a9, identifier: FR55532
2026-03-30 12:38:15 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-30 12:38:15 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-30 12:38:15 [auto1.it] INFO: Scrape type for RM24928: 2
2026-03-30 12:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-30 12:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with scrape type 2
2026-03-30 12:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with scrape type 2
2026-03-30 12:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6, identifier: RM24928
2026-03-30 12:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-30 12:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532
2026-03-30 12:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f1540861-55d8-5622-83cc-65661a4f82a9 with identifier: FR55532 to the API
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:18:13Z',
'fuel_type': 'petrol',
'id': 'f1540861-55d8-5622-83cc-65661a4f82a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR55532',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 83364,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-30',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2018}
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-30 12:38:15 [auto1.it] INFO: Saving data for FR55532: {'auction_closing_time': 1774883893.0, 'created_time': 1774699641.021735, 'last_price_update_time': 1774874295.51741}
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FR55532') HTTP/1.1" 204 0
2026-03-30 12:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-30 12:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928
2026-03-30 12:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6 with identifier: RM24928 to the API
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:42:56Z',
'fuel_type': 'gas',
'id': '38b1a1f0-8f36-5f25-8f24-e3b1d09b0ac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM24928',
'listing': 'auction',
'make': 'Ssangyong',
'model': 'Korando',
'odometer': 173620,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-28',
'seller_name': None,
'title': 'Ssangyong Korando 2.0 GPL Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2015}
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-30 12:38:15 [auto1.it] INFO: Saving data for RM24928: {'auction_closing_time': 1774885376.0, 'created_time': 1774699527.787276, 'last_price_update_time': 1774874295.894385}
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RM24928') HTTP/1.1" 204 0
2026-03-30 12:38:15 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-30 12:38:15 [auto1.it] INFO: Scrape type for BL56378: 2
2026-03-30 12:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-30 12:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc64f1a0-7cc1-54f3-a24d-e5aac844053c with scrape type 2
2026-03-30 12:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc64f1a0-7cc1-54f3-a24d-e5aac844053c with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc64f1a0-7cc1-54f3-a24d-e5aac844053c, identifier: BL56378
2026-03-30 12:38:16 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-30 12:38:16 [auto1.it] INFO: Scrape type for DF57379: 2
2026-03-30 12:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-30 12:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786c1b3f-9ca3-50b5-a222-ea76f64826be with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786c1b3f-9ca3-50b5-a222-ea76f64826be with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 786c1b3f-9ca3-50b5-a222-ea76f64826be, identifier: DF57379
2026-03-30 12:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-30 12:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378
2026-03-30 12:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc64f1a0-7cc1-54f3-a24d-e5aac844053c with identifier: BL56378 to the API
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:55:26Z',
'fuel_type': 'petrol',
'id': 'dc64f1a0-7cc1-54f3-a24d-e5aac844053c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL56378',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Bora',
'odometer': 115580,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-10-17',
'seller_name': None,
'title': 'Volkswagen Bora 1.6',
'transmission': 'manual',
'trim': '',
'year': 2000}
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-30 12:38:16 [auto1.it] INFO: Saving data for BL56378: {'auction_closing_time': 1774886126.0, 'created_time': 1774699533.387302, 'last_price_update_time': 1774874296.420711}
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BL56378') HTTP/1.1" 204 0
2026-03-30 12:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-30 12:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379
2026-03-30 12:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 786c1b3f-9ca3-50b5-a222-ea76f64826be with identifier: DF57379 to the API
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:35:43Z',
'fuel_type': 'diesel',
'id': '786c1b3f-9ca3-50b5-a222-ea76f64826be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF57379',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 139509,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-30 12:38:16 [auto1.it] INFO: Saving data for DF57379: {'auction_closing_time': 1774884943.0, 'created_time': 1774699530.547742, 'last_price_update_time': 1774874296.749453}
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF57379') HTTP/1.1" 204 0
2026-03-30 12:38:16 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-30 12:38:16 [auto1.it] INFO: Scrape type for HF54587: 2
2026-03-30 12:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-30 12:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb, identifier: HF54587
2026-03-30 12:38:16 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-30 12:38:16 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-30 12:38:16 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-30 12:38:16 [auto1.it] INFO: Scrape type for UN20093: 2
2026-03-30 12:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-30 12:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7d8151-7119-57f9-be13-cd5ecb373c85 with scrape type 2
2026-03-30 12:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7d8151-7119-57f9-be13-cd5ecb373c85 with scrape type 2
2026-03-30 12:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1b7d8151-7119-57f9-be13-cd5ecb373c85, identifier: UN20093
2026-03-30 12:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-30 12:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587
2026-03-30 12:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49c7ed60-fa24-578f-8472-4fe6ee5fc6eb with identifier: HF54587 to the API
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:56:48Z',
'fuel_type': 'petrol',
'id': '49c7ed60-fa24-578f-8472-4fe6ee5fc6eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF54587',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 172321,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-31',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2009}
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-30 12:38:17 [auto1.it] INFO: Saving data for HF54587: {'auction_closing_time': 1774886208.0, 'created_time': 1774343224.005639, 'last_price_update_time': 1774874297.281283}
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF54587') HTTP/1.1" 204 0
2026-03-30 12:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-30 12:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093
2026-03-30 12:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1b7d8151-7119-57f9-be13-cd5ecb373c85 with identifier: UN20093 to the API
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:22:28Z',
'fuel_type': 'diesel',
'id': '1b7d8151-7119-57f9-be13-cd5ecb373c85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN20093',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 231959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
'transmission': 'manual',
'trim': 'Business BlueMotion',
'year': 2018}
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-30 12:38:17 [auto1.it] INFO: Saving data for UN20093: {'auction_closing_time': 1774884148.0, 'created_time': 1774699639.378236, 'last_price_update_time': 1774874297.571548}
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN20093') HTTP/1.1" 204 0
2026-03-30 12:38:17 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-30 12:38:17 [auto1.it] INFO: Scrape type for AY76833: 2
2026-03-30 12:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-30 12:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with scrape type 2
2026-03-30 12:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with scrape type 2
2026-03-30 12:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91bf022d-7d60-5a1a-80ee-3a1d403d3872, identifier: AY76833
2026-03-30 12:38:17 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-30 12:38:17 [auto1.it] INFO: Scrape type for UT21803: 2
2026-03-30 12:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-30 12:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with scrape type 2
2026-03-30 12:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with scrape type 2
2026-03-30 12:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5f238ddb-4a51-5a42-b456-4fe42904a8e3, identifier: UT21803
2026-03-30 12:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-30 12:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833
2026-03-30 12:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91bf022d-7d60-5a1a-80ee-3a1d403d3872 with identifier: AY76833 to the API
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:21Z',
'fuel_type': 'diesel',
'id': '91bf022d-7d60-5a1a-80ee-3a1d403d3872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY76833',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 142409,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-12',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Executive 4x4',
'transmission': 'automatic',
'trim': 'Executive 4x4',
'year': 2019}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-30 12:38:18 [auto1.it] INFO: Saving data for AY76833: {'auction_closing_time': 1774883841.0, 'created_time': 1774699555.232959, 'last_price_update_time': 1774874298.038385}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY76833') HTTP/1.1" 204 0
2026-03-30 12:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-30 12:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803
2026-03-30 12:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5f238ddb-4a51-5a42-b456-4fe42904a8e3 with identifier: UT21803 to the API
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:20:22Z',
'fuel_type': 'diesel',
'id': '5f238ddb-4a51-5a42-b456-4fe42904a8e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT21803',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 94776,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-03',
'seller_name': None,
'title': 'Fiat Panda 1.3 JTD Cross 4x4',
'transmission': 'manual',
'trim': 'Cross 4x4',
'year': 2011}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-30 12:38:18 [auto1.it] INFO: Saving data for UT21803: {'auction_closing_time': 1774884022.0, 'created_time': 1773954561.034109, 'last_price_update_time': 1774874298.325544}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT21803') HTTP/1.1" 204 0
2026-03-30 12:38:18 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-30 12:38:18 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-30 12:38:18 [auto1.it] INFO: Scrape type for CV60870: 2
2026-03-30 12:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-30 12:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with scrape type 2
2026-03-30 12:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with scrape type 2
2026-03-30 12:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 28b19035-1a98-52a4-bb34-7fd2b6c422b5, identifier: CV60870
2026-03-30 12:38:18 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-30 12:38:18 [auto1.it] INFO: Scrape type for RC42052: 2
2026-03-30 12:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-30 12:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with scrape type 2
2026-03-30 12:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with scrape type 2
2026-03-30 12:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d847a549-bef9-5b48-b0af-ad4a5c54f2d2, identifier: RC42052
2026-03-30 12:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-30 12:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870
2026-03-30 12:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 28b19035-1a98-52a4-bb34-7fd2b6c422b5 with identifier: CV60870 to the API
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:30Z',
'fuel_type': 'diesel',
'id': '28b19035-1a98-52a4-bb34-7fd2b6c422b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV60870',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 304018,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-13',
'seller_name': None,
'title': 'Audi A6 2.7 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-30 12:38:18 [auto1.it] INFO: Saving data for CV60870: {'auction_closing_time': 1774883070.0, 'created_time': 1774699538.51216, 'last_price_update_time': 1774874298.815496}
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CV60870') HTTP/1.1" 204 0
2026-03-30 12:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-30 12:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052
2026-03-30 12:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d847a549-bef9-5b48-b0af-ad4a5c54f2d2 with identifier: RC42052 to the API
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 400,
'expiration_date': '2026-03-30T15:31:44Z',
'fuel_type': 'petrol',
'id': 'd847a549-bef9-5b48-b0af-ad4a5c54f2d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC42052',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3 Sportback',
'odometer': 102308,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-27',
'seller_name': None,
'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2021}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-30 12:38:19 [auto1.it] INFO: Saving data for RC42052: {'auction_closing_time': 1774884704.0, 'created_time': 1774699641.580747, 'last_price_update_time': 1774874299.203969}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC42052') HTTP/1.1" 204 0
2026-03-30 12:38:19 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-30 12:38:19 [auto1.it] INFO: Scrape type for PM98470: 2
2026-03-30 12:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-30 12:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42697d75-a4de-5898-8892-32911d555c6f with scrape type 2
2026-03-30 12:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42697d75-a4de-5898-8892-32911d555c6f with scrape type 2
2026-03-30 12:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42697d75-a4de-5898-8892-32911d555c6f, identifier: PM98470
2026-03-30 12:38:19 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-30 12:38:19 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-30 12:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-30 12:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470
2026-03-30 12:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42697d75-a4de-5898-8892-32911d555c6f with identifier: PM98470 to the API
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:31Z',
'fuel_type': 'diesel',
'id': '42697d75-a4de-5898-8892-32911d555c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM98470',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 191601,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-25',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Sport Edition BlueMotion Tech.',
'transmission': 'automatic',
'trim': 'Sport Edition BlueMotion Tech.',
'year': 2016}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-30 12:38:19 [auto1.it] INFO: Saving data for PM98470: {'auction_closing_time': 1774883311.0, 'created_time': 1773911212.078176, 'last_price_update_time': 1774874299.596999}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM98470') HTTP/1.1" 204 0
2026-03-30 12:38:19 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-30 12:38:19 [auto1.it] INFO: Scrape type for XT30792: 2
2026-03-30 12:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-30 12:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3b05b74-84a5-55fa-b47e-212e0392da9e with scrape type 2
2026-03-30 12:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3b05b74-84a5-55fa-b47e-212e0392da9e with scrape type 2
2026-03-30 12:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3b05b74-84a5-55fa-b47e-212e0392da9e, identifier: XT30792
2026-03-30 12:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-30 12:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792
2026-03-30 12:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3b05b74-84a5-55fa-b47e-212e0392da9e with identifier: XT30792 to the API
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:52:32Z',
'fuel_type': 'petrol',
'id': 'c3b05b74-84a5-55fa-b47e-212e0392da9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT30792',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 155548,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-29',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2014}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-30 12:38:19 [auto1.it] INFO: Saving data for XT30792: {'auction_closing_time': 1774885952.0, 'created_time': 1773934897.903183, 'last_price_update_time': 1774874299.992675}
2026-03-30 12:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT30792') HTTP/1.1" 204 0
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-30 12:38:20 [auto1.it] INFO: Scrape type for KM48378: 2
2026-03-30 12:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-30 12:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff83685c-2005-5f9d-ad58-21daba76a93b with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff83685c-2005-5f9d-ad58-21daba76a93b with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff83685c-2005-5f9d-ad58-21daba76a93b, identifier: KM48378
2026-03-30 12:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-30 12:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378
2026-03-30 12:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff83685c-2005-5f9d-ad58-21daba76a93b with identifier: KM48378 to the API
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:53:50Z',
'fuel_type': 'diesel',
'id': 'ff83685c-2005-5f9d-ad58-21daba76a93b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM48378',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 230746,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-03-07',
'seller_name': None,
'title': 'Skoda Octavia 1.9 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2001}
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-30 12:38:20 [auto1.it] INFO: Saving data for KM48378: {'auction_closing_time': 1774886030.0, 'created_time': 1774699541.317793, 'last_price_update_time': 1774874300.416904}
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM48378') HTTP/1.1" 204 0
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-30 12:38:20 [auto1.it] INFO: Scrape type for ET22397: 2
2026-03-30 12:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-30 12:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f005e36-16d3-5521-82dc-2e1786c34f8b with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f005e36-16d3-5521-82dc-2e1786c34f8b with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f005e36-16d3-5521-82dc-2e1786c34f8b, identifier: ET22397
2026-03-30 12:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-30 12:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397
2026-03-30 12:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f005e36-16d3-5521-82dc-2e1786c34f8b with identifier: ET22397 to the API
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:18:43Z',
'fuel_type': 'diesel',
'id': '0f005e36-16d3-5521-82dc-2e1786c34f8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET22397',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 162211,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-01',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-30 12:38:20 [auto1.it] INFO: Saving data for ET22397: {'auction_closing_time': 1774883923.0, 'created_time': 1774699553.985768, 'last_price_update_time': 1774874300.840543}
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET22397') HTTP/1.1" 204 0
2026-03-30 12:38:20 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-30 12:38:20 [auto1.it] INFO: Scrape type for TB64568: 2
2026-03-30 12:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-30 12:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with scrape type 2
2026-03-30 12:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c, identifier: TB64568
2026-03-30 12:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-30 12:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568
2026-03-30 12:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2fb0b2b2-e0a1-5993-bce2-6dd892729c7c with identifier: TB64568 to the API
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:48:07Z',
'fuel_type': 'diesel',
'id': '2fb0b2b2-e0a1-5993-bce2-6dd892729c7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB64568',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 224642,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-09',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2011}
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-30 12:38:21 [auto1.it] INFO: Saving data for TB64568: {'auction_closing_time': 1774885687.0, 'created_time': 1773136662.671549, 'last_price_update_time': 1774874301.260962}
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB64568') HTTP/1.1" 204 0
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-30 12:38:21 [auto1.it] INFO: Scrape type for ZU99068: 2
2026-03-30 12:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-30 12:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f763ea7-ce15-5ece-896e-a594d3541815 with scrape type 2
2026-03-30 12:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f763ea7-ce15-5ece-896e-a594d3541815 with scrape type 2
2026-03-30 12:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f763ea7-ce15-5ece-896e-a594d3541815, identifier: ZU99068
2026-03-30 12:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-30 12:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068
2026-03-30 12:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f763ea7-ce15-5ece-896e-a594d3541815 with identifier: ZU99068 to the API
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:35:05Z',
'fuel_type': 'petrol',
'id': '4f763ea7-ce15-5ece-896e-a594d3541815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU99068',
'listing': 'auction',
'make': 'Jaguar',
'model': 'S-TYPE',
'odometer': 57911,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-19',
'seller_name': None,
'title': 'Jaguar S-TYPE 2.5 V6 Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2003}
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-30 12:38:21 [auto1.it] INFO: Saving data for ZU99068: {'auction_closing_time': 1774884905.0, 'created_time': 1774699640.587364, 'last_price_update_time': 1774874301.784966}
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZU99068') HTTP/1.1" 204 0
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-30 12:38:21 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-30 12:38:21 [auto1.it] INFO: Scrape type for DU34377: 2
2026-03-30 12:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-30 12:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200375bf-4134-55bb-af6f-34f20e37f617 with scrape type 2
2026-03-30 12:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200375bf-4134-55bb-af6f-34f20e37f617 with scrape type 2
2026-03-30 12:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 200375bf-4134-55bb-af6f-34f20e37f617, identifier: DU34377
2026-03-30 12:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-30 12:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-03-30 12:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377 to the API
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:14:28Z',
'fuel_type': 'diesel',
'id': '200375bf-4134-55bb-af6f-34f20e37f617',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU34377',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 223232,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-05',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2007}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-30 12:38:22 [auto1.it] INFO: Saving data for DU34377: {'auction_closing_time': 1774883668.0, 'created_time': 1774699591.411869, 'last_price_update_time': 1774874302.182867}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DU34377') HTTP/1.1" 204 0
2026-03-30 12:38:22 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-30 12:38:22 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-30 12:38:22 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-30 12:38:22 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-30 12:38:22 [auto1.it] INFO: Scrape type for NA95464: 2
2026-03-30 12:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-30 12:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91878baa-e7fb-545e-8514-a7e76e620491 with scrape type 2
2026-03-30 12:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91878baa-e7fb-545e-8514-a7e76e620491 with scrape type 2
2026-03-30 12:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91878baa-e7fb-545e-8514-a7e76e620491, identifier: NA95464
2026-03-30 12:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-30 12:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464
2026-03-30 12:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91878baa-e7fb-545e-8514-a7e76e620491 with identifier: NA95464 to the API
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:20:09Z',
'fuel_type': 'diesel',
'id': '91878baa-e7fb-545e-8514-a7e76e620491',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA95464',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 163512,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Audi Q5 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-30 12:38:22 [auto1.it] INFO: Saving data for NA95464: {'auction_closing_time': 1774884009.0, 'created_time': 1774343254.893295, 'last_price_update_time': 1774874302.604309}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NA95464') HTTP/1.1" 204 0
2026-03-30 12:38:22 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-30 12:38:22 [auto1.it] INFO: Scrape type for WA05506: 2
2026-03-30 12:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-30 12:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 2
2026-03-30 12:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 2
2026-03-30 12:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d9c297f-ad9d-5faf-b514-c63740f12274, identifier: WA05506
2026-03-30 12:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-30 12:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-03-30 12:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506 to the API
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:33:12Z',
'fuel_type': 'petrol',
'id': '0d9c297f-ad9d-5faf-b514-c63740f12274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA05506',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 154433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-25',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2008}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-30 12:38:22 [auto1.it] INFO: Saving data for WA05506: {'auction_closing_time': 1774884792.0, 'created_time': 1774699569.588945, 'last_price_update_time': 1774874302.987306}
2026-03-30 12:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA05506') HTTP/1.1" 204 0
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-30 12:38:23 [auto1.it] INFO: Scrape type for PW96424: 2
2026-03-30 12:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-30 12:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0437454a-c4ee-5219-afae-d05af5af81e8 with scrape type 2
2026-03-30 12:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0437454a-c4ee-5219-afae-d05af5af81e8 with scrape type 2
2026-03-30 12:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0437454a-c4ee-5219-afae-d05af5af81e8, identifier: PW96424
2026-03-30 12:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-30 12:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424
2026-03-30 12:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0437454a-c4ee-5219-afae-d05af5af81e8 with identifier: PW96424 to the API
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:56:16Z',
'fuel_type': 'petrol',
'id': '0437454a-c4ee-5219-afae-d05af5af81e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW96424',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 244130,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-07',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2016}
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-30 12:38:23 [auto1.it] INFO: Saving data for PW96424: {'auction_closing_time': 1774886176.0, 'created_time': 1774699567.99309, 'last_price_update_time': 1774874303.488542}
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW96424') HTTP/1.1" 204 0
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-30 12:38:23 [auto1.it] INFO: Scrape type for WE07120: 2
2026-03-30 12:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-30 12:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00bd372-daee-5485-9760-fa7b77557807 with scrape type 2
2026-03-30 12:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00bd372-daee-5485-9760-fa7b77557807 with scrape type 2
2026-03-30 12:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f00bd372-daee-5485-9760-fa7b77557807, identifier: WE07120
2026-03-30 12:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-30 12:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120
2026-03-30 12:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f00bd372-daee-5485-9760-fa7b77557807 with identifier: WE07120 to the API
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:26:54Z',
'fuel_type': 'petrol',
'id': 'f00bd372-daee-5485-9760-fa7b77557807',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE07120',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 179033,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.0 Turbo First Edition',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2017}
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-30 12:38:23 [auto1.it] INFO: Saving data for WE07120: {'auction_closing_time': 1774884414.0, 'created_time': 1774699647.401191, 'last_price_update_time': 1774874303.883784}
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WE07120') HTTP/1.1" 204 0
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-30 12:38:23 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-30 12:38:23 [auto1.it] INFO: Scrape type for VZ92626: 2
2026-03-30 12:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-30 12:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 2
2026-03-30 12:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 2
2026-03-30 12:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97e1cd2b-d1b2-5397-991c-5860318ef193, identifier: VZ92626
2026-03-30 12:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-30 12:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-03-30 12:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626 to the API
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:49:44Z',
'fuel_type': 'petrol',
'id': '97e1cd2b-d1b2-5397-991c-5860318ef193',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ92626',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 202462,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-16',
'seller_name': None,
'title': 'Suzuki SX4 1.6 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2010}
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-30 12:38:24 [auto1.it] INFO: Saving data for VZ92626: {'auction_closing_time': 1774885784.0, 'created_time': 1774699567.442583, 'last_price_update_time': 1774874304.302346}
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ92626') HTTP/1.1" 204 0
2026-03-30 12:38:24 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-30 12:38:24 [auto1.it] INFO: Scrape type for TF83722: 2
2026-03-30 12:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-30 12:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with scrape type 2
2026-03-30 12:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with scrape type 2
2026-03-30 12:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f068d1a-c219-5ee3-ad76-97ed8854fa78, identifier: TF83722
2026-03-30 12:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-30 12:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722
2026-03-30 12:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f068d1a-c219-5ee3-ad76-97ed8854fa78 with identifier: TF83722 to the API
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:03:25Z',
'fuel_type': 'petrol',
'id': '7f068d1a-c219-5ee3-ad76-97ed8854fa78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF83722',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara Picasso',
'odometer': 118576,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-13',
'seller_name': None,
'title': 'Citroen Xsara Picasso 1.6 Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2003}
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-30 12:38:24 [auto1.it] INFO: Saving data for TF83722: {'auction_closing_time': 1774883005.0, 'created_time': 1774699562.890582, 'last_price_update_time': 1774874304.805611}
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TF83722') HTTP/1.1" 204 0
2026-03-30 12:38:24 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-30 12:38:24 [auto1.it] INFO: Scrape type for BA01278: 2
2026-03-30 12:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-30 12:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb652e9-c41c-5be4-b3fb-00beff0f6480 with scrape type 2
2026-03-30 12:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdb652e9-c41c-5be4-b3fb-00beff0f6480 with scrape type 2
2026-03-30 12:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bdb652e9-c41c-5be4-b3fb-00beff0f6480, identifier: BA01278
2026-03-30 12:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-30 12:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278
2026-03-30 12:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bdb652e9-c41c-5be4-b3fb-00beff0f6480 with identifier: BA01278 to the API
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:48:10Z',
'fuel_type': 'petrol',
'id': 'bdb652e9-c41c-5be4-b3fb-00beff0f6480',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA01278',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 46356,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-02',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-30 12:38:25 [auto1.it] INFO: Saving data for BA01278: {'auction_closing_time': 1774885690.0, 'created_time': 1774699568.83016, 'last_price_update_time': 1774874305.313725}
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BA01278') HTTP/1.1" 204 0
2026-03-30 12:38:25 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-30 12:38:25 [auto1.it] INFO: Scrape type for PW47751: 2
2026-03-30 12:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-30 12:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f74791e-15fd-549d-9408-0209871b4e0e with scrape type 2
2026-03-30 12:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f74791e-15fd-549d-9408-0209871b4e0e with scrape type 2
2026-03-30 12:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f74791e-15fd-549d-9408-0209871b4e0e, identifier: PW47751
2026-03-30 12:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-30 12:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751
2026-03-30 12:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f74791e-15fd-549d-9408-0209871b4e0e with identifier: PW47751 to the API
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:35:39Z',
'fuel_type': 'diesel',
'id': '3f74791e-15fd-549d-9408-0209871b4e0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW47751',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 119201,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2019}
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-30 12:38:25 [auto1.it] INFO: Saving data for PW47751: {'auction_closing_time': 1774884939.0, 'created_time': 1774699571.671068, 'last_price_update_time': 1774874305.691317}
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW47751') HTTP/1.1" 204 0
2026-03-30 12:38:25 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-30 12:38:25 [auto1.it] INFO: Scrape type for CU74500: 2
2026-03-30 12:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-30 12:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with scrape type 2
2026-03-30 12:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with scrape type 2
2026-03-30 12:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16, identifier: CU74500
2026-03-30 12:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-30 12:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500
2026-03-30 12:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2a0321c5-b70b-55b1-9c1f-b0b3da6ead16 with identifier: CU74500 to the API
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:58Z',
'fuel_type': 'petrol',
'id': '2a0321c5-b70b-55b1-9c1f-b0b3da6ead16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU74500',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 89185,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2011}
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-30 12:38:26 [auto1.it] INFO: Saving data for CU74500: {'auction_closing_time': 1774882858.0, 'created_time': 1774699536.732754, 'last_price_update_time': 1774874306.09734}
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU74500') HTTP/1.1" 204 0
2026-03-30 12:38:26 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-30 12:38:26 [auto1.it] INFO: Scrape type for SB06120: 2
2026-03-30 12:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-30 12:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with scrape type 2
2026-03-30 12:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with scrape type 2
2026-03-30 12:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dcf2a9c-dbdc-5011-830a-9f40907f3173, identifier: SB06120
2026-03-30 12:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-30 12:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120
2026-03-30 12:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dcf2a9c-dbdc-5011-830a-9f40907f3173 with identifier: SB06120 to the API
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:05:02Z',
'fuel_type': 'petrol',
'id': '5dcf2a9c-dbdc-5011-830a-9f40907f3173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB06120',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 65325,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-30',
'seller_name': None,
'title': 'Fiat Panda 0.9 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-30 12:38:26 [auto1.it] INFO: Saving data for SB06120: {'auction_closing_time': 1774883102.0, 'created_time': 1774699551.852851, 'last_price_update_time': 1774874306.600056}
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB06120') HTTP/1.1" 204 0
2026-03-30 12:38:26 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-30 12:38:26 [auto1.it] INFO: Channel: 24h | Page: 84 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:26 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-30 12:38:26 [auto1.it] INFO: Scrape type for ZK25339: 2
2026-03-30 12:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-30 12:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f93518-da89-5cb0-87ba-5969728c3566 with scrape type 2
2026-03-30 12:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f93518-da89-5cb0-87ba-5969728c3566 with scrape type 2
2026-03-30 12:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 19f93518-da89-5cb0-87ba-5969728c3566, identifier: ZK25339
2026-03-30 12:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-30 12:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339
2026-03-30 12:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 19f93518-da89-5cb0-87ba-5969728c3566 with identifier: ZK25339 to the API
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:38:36Z',
'fuel_type': 'petrol',
'id': '19f93518-da89-5cb0-87ba-5969728c3566',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK25339',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 220508,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-21',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2014}
2026-03-30 12:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Saving data for ZK25339: {'auction_closing_time': 1774885116.0, 'created_time': 1774699562.117025, 'last_price_update_time': 1774874307.005359}
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK25339') HTTP/1.1" 204 0
2026-03-30 12:38:27 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-30 12:38:27 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Scrape type for VY27693: 2
2026-03-30 12:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-30 12:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101787d-807d-5642-b1ac-827c628c6848 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e101787d-807d-5642-b1ac-827c628c6848 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e101787d-807d-5642-b1ac-827c628c6848, identifier: VY27693
2026-03-30 12:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-30 12:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693
2026-03-30 12:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e101787d-807d-5642-b1ac-827c628c6848 with identifier: VY27693 to the API
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:37:17Z',
'fuel_type': 'petrol',
'id': 'e101787d-807d-5642-b1ac-827c628c6848',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY27693',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 81336,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-20',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2008}
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Saving data for VY27693: {'auction_closing_time': 1774885037.0, 'created_time': 1774699552.589725, 'last_price_update_time': 1774874307.42649}
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VY27693') HTTP/1.1" 204 0
2026-03-30 12:38:27 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Scrape type for JZ77925: 2
2026-03-30 12:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-30 12:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859efc99-201c-5de7-8656-ad1f0f754ed1 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859efc99-201c-5de7-8656-ad1f0f754ed1 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 859efc99-201c-5de7-8656-ad1f0f754ed1, identifier: JZ77925
2026-03-30 12:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-30 12:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925
2026-03-30 12:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 859efc99-201c-5de7-8656-ad1f0f754ed1 with identifier: JZ77925 to the API
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:04Z',
'fuel_type': 'petrol',
'id': '859efc99-201c-5de7-8656-ad1f0f754ed1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ77925',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 212530,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-02',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 Turbo Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2015}
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Saving data for JZ77925: {'auction_closing_time': 1774885144.0, 'created_time': 1774699569.238944, 'last_price_update_time': 1774874307.822019}
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ77925') HTTP/1.1" 204 0
2026-03-30 12:38:27 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-30 12:38:27 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-30 12:38:27 [auto1.it] INFO: Scrape type for LN66513: 2
2026-03-30 12:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-30 12:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with scrape type 2
2026-03-30 12:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b157ce1c-c9d1-555e-9b81-8a5e18c654e9, identifier: LN66513
2026-03-30 12:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-30 12:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513
2026-03-30 12:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b157ce1c-c9d1-555e-9b81-8a5e18c654e9 with identifier: LN66513 to the API
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:04:46Z',
'fuel_type': 'petrol',
'id': 'b157ce1c-c9d1-555e-9b81-8a5e18c654e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN66513',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 45752,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-02',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.it] INFO: Saving data for LN66513: {'auction_closing_time': 1774883086.0, 'created_time': 1774699565.508473, 'last_price_update_time': 1774874308.216167}
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN66513') HTTP/1.1" 204 0
2026-03-30 12:38:28 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.it] INFO: Scrape type for CE47539: 2
2026-03-30 12:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-30 12:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6997b28-256f-5be2-8aee-fa9e98aee5d0 with scrape type 2
2026-03-30 12:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6997b28-256f-5be2-8aee-fa9e98aee5d0 with scrape type 2
2026-03-30 12:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6997b28-256f-5be2-8aee-fa9e98aee5d0, identifier: CE47539
2026-03-30 12:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-30 12:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539
2026-03-30 12:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6997b28-256f-5be2-8aee-fa9e98aee5d0 with identifier: CE47539 to the API
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:50:34Z',
'fuel_type': 'petrol',
'id': 'a6997b28-256f-5be2-8aee-fa9e98aee5d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE47539',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 150658,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-16',
'seller_name': None,
'title': 'Renault Clio 1.2 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2014}
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.it] INFO: Saving data for CE47539: {'auction_closing_time': 1774885834.0, 'created_time': 1774699572.841006, 'last_price_update_time': 1774874308.617037}
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE47539') HTTP/1.1" 204 0
2026-03-30 12:38:28 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-30 12:38:28 [auto1.it] INFO: Scrape type for ET05908: 2
2026-03-30 12:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-30 12:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0941f7ce-8192-5540-beaf-6361d966fc21 with scrape type 2
2026-03-30 12:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0941f7ce-8192-5540-beaf-6361d966fc21 with scrape type 2
2026-03-30 12:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0941f7ce-8192-5540-beaf-6361d966fc21, identifier: ET05908
2026-03-30 12:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-30 12:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908
2026-03-30 12:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0941f7ce-8192-5540-beaf-6361d966fc21 with identifier: ET05908 to the API
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:57Z',
'fuel_type': 'diesel',
'id': '0941f7ce-8192-5540-beaf-6361d966fc21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET05908',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 106468,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-11',
'seller_name': None,
'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
'transmission': 'automatic',
'trim': 'D LT 4WD',
'year': 2008}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Saving data for ET05908: {'auction_closing_time': 1774883037.0, 'created_time': 1774699553.271026, 'last_price_update_time': 1774874309.028123}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET05908') HTTP/1.1" 204 0
2026-03-30 12:38:29 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-30 12:38:29 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Scrape type for YF75384: 2
2026-03-30 12:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-30 12:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a01347a-afaf-5d36-9027-acdc73c66feb with scrape type 2
2026-03-30 12:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a01347a-afaf-5d36-9027-acdc73c66feb with scrape type 2
2026-03-30 12:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a01347a-afaf-5d36-9027-acdc73c66feb, identifier: YF75384
2026-03-30 12:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-30 12:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384
2026-03-30 12:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a01347a-afaf-5d36-9027-acdc73c66feb with identifier: YF75384 to the API
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:14Z',
'fuel_type': 'diesel',
'id': '7a01347a-afaf-5d36-9027-acdc73c66feb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF75384',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 195074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-27',
'seller_name': None,
'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2020}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Saving data for YF75384: {'auction_closing_time': 1774884494.0, 'created_time': 1773868360.122214, 'last_price_update_time': 1774874309.453711}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YF75384') HTTP/1.1" 204 0
2026-03-30 12:38:29 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Scrape type for YP53845: 2
2026-03-30 12:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-30 12:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with scrape type 2
2026-03-30 12:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with scrape type 2
2026-03-30 12:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028, identifier: YP53845
2026-03-30 12:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-30 12:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845
2026-03-30 12:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e54f4eb-6a12-51c2-8bbe-e4a64bf35028 with identifier: YP53845 to the API
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:29:30Z',
'fuel_type': 'petrol',
'id': '1e54f4eb-6a12-51c2-8bbe-e4a64bf35028',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP53845',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 108451,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-02',
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2010}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Saving data for YP53845: {'auction_closing_time': 1774884570.0, 'created_time': 1774343240.609246, 'last_price_update_time': 1774874309.932218}
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP53845') HTTP/1.1" 204 0
2026-03-30 12:38:29 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-30 12:38:29 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-30 12:38:29 [auto1.it] INFO: Scrape type for DV89996: 2
2026-03-30 12:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-30 12:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a25493cd-b05c-5c17-bb7e-d0612eb87950 with scrape type 2
2026-03-30 12:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a25493cd-b05c-5c17-bb7e-d0612eb87950 with scrape type 2
2026-03-30 12:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a25493cd-b05c-5c17-bb7e-d0612eb87950, identifier: DV89996
2026-03-30 12:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-30 12:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996
2026-03-30 12:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a25493cd-b05c-5c17-bb7e-d0612eb87950 with identifier: DV89996 to the API
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:55:31Z',
'fuel_type': 'petrol',
'id': 'a25493cd-b05c-5c17-bb7e-d0612eb87950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV89996',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 74129,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-27',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2015}
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-30 12:38:30 [auto1.it] INFO: Saving data for DV89996: {'auction_closing_time': 1774886131.0, 'created_time': 1774699539.911877, 'last_price_update_time': 1774874310.338227}
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV89996') HTTP/1.1" 204 0
2026-03-30 12:38:30 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-30 12:38:30 [auto1.it] INFO: Scrape type for GC21308: 2
2026-03-30 12:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-30 12:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with scrape type 2
2026-03-30 12:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with scrape type 2
2026-03-30 12:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97978bda-0d93-5484-92c8-f1ce53e9d5c2, identifier: GC21308
2026-03-30 12:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-30 12:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308
2026-03-30 12:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97978bda-0d93-5484-92c8-f1ce53e9d5c2 with identifier: GC21308 to the API
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 111,
'expiration_date': '2026-03-30T15:55:51Z',
'fuel_type': 'petrol',
'id': '97978bda-0d93-5484-92c8-f1ce53e9d5c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC21308',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 173534,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-14',
'seller_name': None,
'title': 'Suzuki Vitara 1.0 BoosterJet Star View 4x2',
'transmission': 'manual',
'trim': 'Star View 4x2',
'year': 2019}
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-30 12:38:30 [auto1.it] INFO: Saving data for GC21308: {'auction_closing_time': 1774886151.0, 'created_time': 1774699552.240307, 'last_price_update_time': 1774874310.724419}
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC21308') HTTP/1.1" 204 0
2026-03-30 12:38:30 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-30 12:38:30 [auto1.it] INFO: Scrape type for WN69179: 2
2026-03-30 12:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-30 12:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fa818f-fb69-545b-978b-23bcaecd0161 with scrape type 2
2026-03-30 12:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4fa818f-fb69-545b-978b-23bcaecd0161 with scrape type 2
2026-03-30 12:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4fa818f-fb69-545b-978b-23bcaecd0161, identifier: WN69179
2026-03-30 12:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-30 12:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179
2026-03-30 12:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4fa818f-fb69-545b-978b-23bcaecd0161 with identifier: WN69179 to the API
2026-03-30 12:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:07:50Z',
'fuel_type': 'petrol',
'id': 'a4fa818f-fb69-545b-978b-23bcaecd0161',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN69179',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 162853,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-15',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2009}
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-30 12:38:31 [auto1.it] INFO: Saving data for WN69179: {'auction_closing_time': 1774883270.0, 'created_time': 1774699548.800788, 'last_price_update_time': 1774874311.437987}
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WN69179') HTTP/1.1" 204 0
2026-03-30 12:38:31 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-30 12:38:31 [auto1.it] INFO: Scrape type for RT68139: 2
2026-03-30 12:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-30 12:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with scrape type 2
2026-03-30 12:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with scrape type 2
2026-03-30 12:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd, identifier: RT68139
2026-03-30 12:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-30 12:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139
2026-03-30 12:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd with identifier: RT68139 to the API
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:51Z',
'fuel_type': 'diesel',
'id': '65a693bf-72bf-5af1-a1fb-b42d3cd6c6dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT68139',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 178298,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-28',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2017}
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-30 12:38:31 [auto1.it] INFO: Saving data for RT68139: {'auction_closing_time': 1774883331.0, 'created_time': 1774699550.126643, 'last_price_update_time': 1774874311.912844}
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RT68139') HTTP/1.1" 204 0
2026-03-30 12:38:31 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-30 12:38:31 [auto1.it] INFO: Scrape type for GU07540: 2
2026-03-30 12:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-30 12:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088d57a3-5af2-5c36-a990-35ce8808940e with scrape type 2
2026-03-30 12:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088d57a3-5af2-5c36-a990-35ce8808940e with scrape type 2
2026-03-30 12:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 088d57a3-5af2-5c36-a990-35ce8808940e, identifier: GU07540
2026-03-30 12:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-30 12:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540
2026-03-30 12:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 088d57a3-5af2-5c36-a990-35ce8808940e with identifier: GU07540 to the API
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:59:29Z',
'fuel_type': 'petrol',
'id': '088d57a3-5af2-5c36-a990-35ce8808940e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU07540',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 122878,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-23',
'seller_name': None,
'title': 'Citroen C1 1.0 Seduction',
'transmission': 'manual',
'trim': 'Seduction',
'year': 2012}
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-30 12:38:32 [auto1.it] INFO: Saving data for GU07540: {'auction_closing_time': 1774886369.0, 'created_time': 1774699546.282674, 'last_price_update_time': 1774874312.320304}
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GU07540') HTTP/1.1" 204 0
2026-03-30 12:38:32 [auto1.it] INFO: Channel: 24h | Page: 85 | totalHits: 3597 | hits on page: 40
2026-03-30 12:38:32 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-30 12:38:32 [auto1.it] INFO: Scrape type for MJ56294: 2
2026-03-30 12:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-30 12:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8ac6608-4456-5c52-9330-2be57d5ec0ad with scrape type 2
2026-03-30 12:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8ac6608-4456-5c52-9330-2be57d5ec0ad with scrape type 2
2026-03-30 12:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8ac6608-4456-5c52-9330-2be57d5ec0ad, identifier: MJ56294
2026-03-30 12:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-30 12:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294
2026-03-30 12:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8ac6608-4456-5c52-9330-2be57d5ec0ad with identifier: MJ56294 to the API
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:13Z',
'fuel_type': 'petrol',
'id': 'd8ac6608-4456-5c52-9330-2be57d5ec0ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ56294',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 123392,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-11',
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2008}
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-30 12:38:32 [auto1.it] INFO: Saving data for MJ56294: {'auction_closing_time': 1774884013.0, 'created_time': 1774699555.574814, 'last_price_update_time': 1774874312.860949}
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ56294') HTTP/1.1" 204 0
2026-03-30 12:38:32 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-30 12:38:32 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-30 12:38:32 [auto1.it] INFO: Scrape type for ZX02617: 2
2026-03-30 12:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-30 12:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879e56cb-6dfd-584f-b307-a60aa53227cc with scrape type 2
2026-03-30 12:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879e56cb-6dfd-584f-b307-a60aa53227cc with scrape type 2
2026-03-30 12:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 879e56cb-6dfd-584f-b307-a60aa53227cc, identifier: ZX02617
2026-03-30 12:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:33 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-30 12:38:33 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-30 12:38:33 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-30 12:38:33 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-30 12:38:33 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-30 12:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-30 12:38:33 [auto1.it] INFO: Scrape type for DP83591: 2
2026-03-30 12:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-30 12:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with scrape type 2
2026-03-30 12:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with scrape type 2
2026-03-30 12:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aac817f7-1eea-52ef-b4b4-fbc55a13ff13, identifier: DP83591
2026-03-30 12:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-30 12:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617
2026-03-30 12:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 879e56cb-6dfd-584f-b307-a60aa53227cc with identifier: ZX02617 to the API
2026-03-30 12:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'diesel',
'id': '879e56cb-6dfd-584f-b307-a60aa53227cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX02617',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 142011,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-12',
'seller_name': None,
'title': 'BMW 4er 420d Gran Coupé M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2016}
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-30 12:38:34 [auto1.it] INFO: Saving data for ZX02617: {'auction_closing_time': 1774884460.0, 'created_time': 1774699616.288327, 'last_price_update_time': 1774874314.385934}
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX02617') HTTP/1.1" 204 0
2026-03-30 12:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-30 12:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-03-30 12:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591 to the API
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:46:56Z',
'fuel_type': 'diesel',
'id': 'aac817f7-1eea-52ef-b4b4-fbc55a13ff13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP83591',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 67502,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-04',
'seller_name': None,
'title': 'Land Rover Evoque D165 Mild-Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2021}
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-30 12:38:34 [auto1.it] INFO: Saving data for DP83591: {'auction_closing_time': 1774885616.0, 'created_time': 1774699558.963987, 'last_price_update_time': 1774874314.790469}
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP83591') HTTP/1.1" 204 0
2026-03-30 12:38:34 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-30 12:38:34 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-30 12:38:34 [auto1.it] INFO: Scrape type for LF71839: 2
2026-03-30 12:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-30 12:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with scrape type 2
2026-03-30 12:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with scrape type 2
2026-03-30 12:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e, identifier: LF71839
2026-03-30 12:38:34 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-30 12:38:34 [auto1.it] INFO: Scrape type for DF10030: 2
2026-03-30 12:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-30 12:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with scrape type 2
2026-03-30 12:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with scrape type 2
2026-03-30 12:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a, identifier: DF10030
2026-03-30 12:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-30 12:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839
2026-03-30 12:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f7db5a3-4d0d-5f29-a092-d00e71c3962e with identifier: LF71839 to the API
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:29:05Z',
'fuel_type': 'petrol',
'id': '1f7db5a3-4d0d-5f29-a092-d00e71c3962e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF71839',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 120280,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-30',
'seller_name': None,
'title': 'Fiat 500C 1.2 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2015}
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-30 12:38:35 [auto1.it] INFO: Saving data for LF71839: {'auction_closing_time': 1774884545.0, 'created_time': 1774699601.608924, 'last_price_update_time': 1774874315.356077}
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LF71839') HTTP/1.1" 204 0
2026-03-30 12:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-30 12:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030
2026-03-30 12:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f3c9d7a-9924-5552-9d4f-def1cec9be0a with identifier: DF10030 to the API
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:16:41Z',
'fuel_type': 'diesel',
'id': '2f3c9d7a-9924-5552-9d4f-def1cec9be0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF10030',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 110898,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-23',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
'transmission': 'automatic',
'trim': 'SDV6 HSE',
'year': 2013}
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-30 12:38:35 [auto1.it] INFO: Saving data for DF10030: {'auction_closing_time': 1774883801.0, 'created_time': 1774699547.352542, 'last_price_update_time': 1774874315.651922}
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DF10030') HTTP/1.1" 204 0
2026-03-30 12:38:35 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-30 12:38:35 [auto1.it] INFO: Scrape type for KV81214: 2
2026-03-30 12:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-30 12:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3274a6e0-0b1a-5aba-a406-beb335beeeee with scrape type 2
2026-03-30 12:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3274a6e0-0b1a-5aba-a406-beb335beeeee with scrape type 2
2026-03-30 12:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3274a6e0-0b1a-5aba-a406-beb335beeeee, identifier: KV81214
2026-03-30 12:38:35 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-30 12:38:35 [auto1.it] INFO: Scrape type for RF53888: 2
2026-03-30 12:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-30 12:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989429ba-1d83-53df-8b9b-db9e62477ae6 with scrape type 2
2026-03-30 12:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989429ba-1d83-53df-8b9b-db9e62477ae6 with scrape type 2
2026-03-30 12:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 989429ba-1d83-53df-8b9b-db9e62477ae6, identifier: RF53888
2026-03-30 12:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-30 12:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214
2026-03-30 12:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3274a6e0-0b1a-5aba-a406-beb335beeeee with identifier: KV81214 to the API
2026-03-30 12:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:53:59Z',
'fuel_type': 'diesel',
'id': '3274a6e0-0b1a-5aba-a406-beb335beeeee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV81214',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 174160,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-18',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-30 12:38:36 [auto1.it] INFO: Saving data for KV81214: {'auction_closing_time': 1774886039.0, 'created_time': 1774699637.910229, 'last_price_update_time': 1774874316.889552}
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KV81214') HTTP/1.1" 204 0
2026-03-30 12:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-30 12:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888
2026-03-30 12:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 989429ba-1d83-53df-8b9b-db9e62477ae6 with identifier: RF53888 to the API
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:38:23Z',
'fuel_type': 'diesel',
'id': '989429ba-1d83-53df-8b9b-db9e62477ae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF53888',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 211346,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-11',
'seller_name': None,
'title': 'BMW 5er 520d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-30 12:38:37 [auto1.it] INFO: Saving data for RF53888: {'auction_closing_time': 1774885103.0, 'created_time': 1774343258.340001, 'last_price_update_time': 1774874317.188931}
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF53888') HTTP/1.1" 204 0
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-30 12:38:37 [auto1.it] INFO: Scrape type for LC50167: 2
2026-03-30 12:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-30 12:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99331b19-07da-57c2-8f19-2bf79e0ae01c with scrape type 2
2026-03-30 12:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99331b19-07da-57c2-8f19-2bf79e0ae01c with scrape type 2
2026-03-30 12:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 99331b19-07da-57c2-8f19-2bf79e0ae01c, identifier: LC50167
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-30 12:38:37 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-30 12:38:37 [auto1.it] INFO: Scrape type for CR10860: 2
2026-03-30 12:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-30 12:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d80ad1-d0bf-5629-997a-5c09972d5593 with scrape type 2
2026-03-30 12:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1d80ad1-d0bf-5629-997a-5c09972d5593 with scrape type 2
2026-03-30 12:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1d80ad1-d0bf-5629-997a-5c09972d5593, identifier: CR10860
2026-03-30 12:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-30 12:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167
2026-03-30 12:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 99331b19-07da-57c2-8f19-2bf79e0ae01c with identifier: LC50167 to the API
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:56:42Z',
'fuel_type': 'diesel',
'id': '99331b19-07da-57c2-8f19-2bf79e0ae01c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC50167',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 173084,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2010}
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-30 12:38:37 [auto1.it] INFO: Saving data for LC50167: {'auction_closing_time': 1774886202.0, 'created_time': 1774699597.73112, 'last_price_update_time': 1774874317.728785}
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC50167') HTTP/1.1" 204 0
2026-03-30 12:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-30 12:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860
2026-03-30 12:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1d80ad1-d0bf-5629-997a-5c09972d5593 with identifier: CR10860 to the API
2026-03-30 12:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:01:05Z',
'fuel_type': 'diesel',
'id': 'a1d80ad1-d0bf-5629-997a-5c09972d5593',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR10860',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 406300,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-30',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 Turbodiesel',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-30 12:38:38 [auto1.it] INFO: Saving data for CR10860: {'auction_closing_time': 1774882865.0, 'created_time': 1774699646.456517, 'last_price_update_time': 1774874318.151667}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CR10860') HTTP/1.1" 204 0
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-30 12:38:38 [auto1.it] INFO: Scrape type for VU78996: 2
2026-03-30 12:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-30 12:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with scrape type 2
2026-03-30 12:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with scrape type 2
2026-03-30 12:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2, identifier: VU78996
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-30 12:38:38 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-30 12:38:38 [auto1.it] INFO: Scrape type for LW42205: 2
2026-03-30 12:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-30 12:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with scrape type 2
2026-03-30 12:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with scrape type 2
2026-03-30 12:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac, identifier: LW42205
2026-03-30 12:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-30 12:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996
2026-03-30 12:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7fd24d2e-c7a4-5e24-94aa-abb81314b2a2 with identifier: VU78996 to the API
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:30:25Z',
'fuel_type': 'diesel',
'id': '7fd24d2e-c7a4-5e24-94aa-abb81314b2a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU78996',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 87626,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-27',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-30 12:38:38 [auto1.it] INFO: Saving data for VU78996: {'auction_closing_time': 1774884625.0, 'created_time': 1774699638.645932, 'last_price_update_time': 1774874318.659878}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU78996') HTTP/1.1" 204 0
2026-03-30 12:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-30 12:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205
2026-03-30 12:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8411cc7c-3beb-5e38-993e-5f97a95aa9ac with identifier: LW42205 to the API
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:49:20Z',
'fuel_type': 'diesel',
'id': '8411cc7c-3beb-5e38-993e-5f97a95aa9ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW42205',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 239073,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-27',
'seller_name': None,
'title': 'Fiat Panda 1.3 JTD Emotion',
'transmission': 'manual',
'trim': 'Emotion',
'year': 2006}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-30 12:38:38 [auto1.it] INFO: Saving data for LW42205: {'auction_closing_time': 1774885760.0, 'created_time': 1774699646.002182, 'last_price_update_time': 1774874318.983883}
2026-03-30 12:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LW42205') HTTP/1.1" 204 0
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Scrape type for XC50936: 2
2026-03-30 12:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-30 12:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5514494a-dc0b-5478-91e5-55e8c15cd12d with scrape type 2
2026-03-30 12:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5514494a-dc0b-5478-91e5-55e8c15cd12d with scrape type 2
2026-03-30 12:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5514494a-dc0b-5478-91e5-55e8c15cd12d, identifier: XC50936
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Scrape type for PR01158: 2
2026-03-30 12:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-30 12:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with scrape type 2
2026-03-30 12:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with scrape type 2
2026-03-30 12:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65, identifier: PR01158
2026-03-30 12:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-30 12:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936
2026-03-30 12:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5514494a-dc0b-5478-91e5-55e8c15cd12d with identifier: XC50936 to the API
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:46:34Z',
'fuel_type': 'petrol',
'id': '5514494a-dc0b-5478-91e5-55e8c15cd12d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC50936',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 59953,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-25',
'seller_name': None,
'title': 'Audi Q2 30 TFSI Admired',
'transmission': 'manual',
'trim': 'Admired',
'year': 2020}
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Saving data for XC50936: {'auction_closing_time': 1774885594.0, 'created_time': 1774699580.26613, 'last_price_update_time': 1774874319.492639}
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XC50936') HTTP/1.1" 204 0
2026-03-30 12:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-30 12:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158
2026-03-30 12:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2689ec9a-2060-500c-8cd9-3fd4e0b0bf65 with identifier: PR01158 to the API
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:15Z',
'fuel_type': 'diesel',
'id': '2689ec9a-2060-500c-8cd9-3fd4e0b0bf65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR01158',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 132493,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium Business',
'transmission': 'automatic',
'trim': 'Titanium Business',
'year': 2017}
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Saving data for PR01158: {'auction_closing_time': 1774884795.0, 'created_time': 1774699648.298545, 'last_price_update_time': 1774874319.876184}
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR01158') HTTP/1.1" 204 0
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ89280%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Scrape type for NZ89280: 0
2026-03-30 12:38:39 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-30 12:38:39 [auto1.it] INFO: Scrape type for DV86201: 2
2026-03-30 12:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-30 12:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb with scrape type 2
2026-03-30 12:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b437e8b-a37a-53ec-8205-69705c9ab3cb with scrape type 2
2026-03-30 12:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b437e8b-a37a-53ec-8205-69705c9ab3cb, identifier: DV86201
2026-03-30 12:38:40 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-30 12:38:40 [auto1.it] INFO: Scrape type for LU04143: 2
2026-03-30 12:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-30 12:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f82b77-8d52-52f3-a982-0584a35cf205 with scrape type 2
2026-03-30 12:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f82b77-8d52-52f3-a982-0584a35cf205 with scrape type 2
2026-03-30 12:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05f82b77-8d52-52f3-a982-0584a35cf205, identifier: LU04143
2026-03-30 12:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-30 12:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201
2026-03-30 12:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b437e8b-a37a-53ec-8205-69705c9ab3cb with identifier: DV86201 to the API
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:44:12Z',
'fuel_type': 'diesel',
'id': '5b437e8b-a37a-53ec-8205-69705c9ab3cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV86201',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 136949,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2011}
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-30 12:38:40 [auto1.it] INFO: Saving data for DV86201: {'auction_closing_time': 1774885452.0, 'created_time': 1774699599.098912, 'last_price_update_time': 1774874320.454637}
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DV86201') HTTP/1.1" 204 0
2026-03-30 12:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-30 12:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143
2026-03-30 12:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05f82b77-8d52-52f3-a982-0584a35cf205 with identifier: LU04143 to the API
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:52:00Z',
'fuel_type': 'diesel',
'id': '05f82b77-8d52-52f3-a982-0584a35cf205',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU04143',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 187217,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-22',
'seller_name': None,
'title': 'Fiat 500X 1.3 M-Jet Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2015}
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-30 12:38:40 [auto1.it] INFO: Saving data for LU04143: {'auction_closing_time': 1774885920.0, 'created_time': 1774699609.719665, 'last_price_update_time': 1774874320.746503}
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU04143') HTTP/1.1" 204 0
2026-03-30 12:38:40 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-30 12:38:40 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-30 12:38:40 [auto1.it] INFO: Scrape type for CP63934: 2
2026-03-30 12:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-30 12:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5a71111-c106-5fbd-9960-6b2495b2a34a with scrape type 2
2026-03-30 12:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5a71111-c106-5fbd-9960-6b2495b2a34a with scrape type 2
2026-03-30 12:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5a71111-c106-5fbd-9960-6b2495b2a34a, identifier: CP63934
2026-03-30 12:38:40 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-30 12:38:40 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-30 12:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-30 12:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934
2026-03-30 12:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5a71111-c106-5fbd-9960-6b2495b2a34a with identifier: CP63934 to the API
2026-03-30 12:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:36Z',
'fuel_type': 'diesel',
'id': 'a5a71111-c106-5fbd-9960-6b2495b2a34a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP63934',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 218491,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2019}
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.it] INFO: Saving data for CP63934: {'auction_closing_time': 1774884216.0, 'created_time': 1774699623.09519, 'last_price_update_time': 1774874321.186344}
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CP63934') HTTP/1.1" 204 0
2026-03-30 12:38:41 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-30 12:38:41 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-30 12:38:41 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.it] INFO: Scrape type for SM49398: 2
2026-03-30 12:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-30 12:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4defba85-a8b4-560e-9861-f282e4eff9d0 with scrape type 2
2026-03-30 12:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4defba85-a8b4-560e-9861-f282e4eff9d0 with scrape type 2
2026-03-30 12:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4defba85-a8b4-560e-9861-f282e4eff9d0, identifier: SM49398
2026-03-30 12:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-30 12:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398
2026-03-30 12:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4defba85-a8b4-560e-9861-f282e4eff9d0 with identifier: SM49398 to the API
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:54:44Z',
'fuel_type': 'diesel',
'id': '4defba85-a8b4-560e-9861-f282e4eff9d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM49398',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 375010,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-08-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2002}
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.it] INFO: Saving data for SM49398: {'auction_closing_time': 1774886084.0, 'created_time': 1774699587.675376, 'last_price_update_time': 1774874321.575253}
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SM49398') HTTP/1.1" 204 0
2026-03-30 12:38:41 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-30 12:38:41 [auto1.it] INFO: Scrape type for ND99251: 2
2026-03-30 12:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-30 12:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with scrape type 2
2026-03-30 12:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with scrape type 2
2026-03-30 12:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f, identifier: ND99251
2026-03-30 12:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-30 12:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251
2026-03-30 12:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f with identifier: ND99251 to the API
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:49:36Z',
'fuel_type': 'diesel',
'id': 'a6cc93ac-99f6-53e5-81b5-a4ab0dc95a5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND99251',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 167259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-02',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2014}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Saving data for ND99251: {'auction_closing_time': 1774885776.0, 'created_time': 1774343168.357267, 'last_price_update_time': 1774874322.082653}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ND99251') HTTP/1.1" 204 0
2026-03-30 12:38:42 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-30 12:38:42 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Scrape type for DE18860: 2
2026-03-30 12:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-30 12:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7ebd939-dde9-544e-83bf-0dca02f95948, identifier: DE18860
2026-03-30 12:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-30 12:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-03-30 12:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860 to the API
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:33:22Z',
'fuel_type': 'petrol',
'id': 'd7ebd939-dde9-544e-83bf-0dca02f95948',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE18860',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 150019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-29',
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2014}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Saving data for DE18860: {'auction_closing_time': 1774884802.0, 'created_time': 1774699582.153401, 'last_price_update_time': 1774874322.445858}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DE18860') HTTP/1.1" 204 0
2026-03-30 12:38:42 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-30 12:38:42 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Scrape type for NH24051: 2
2026-03-30 12:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-30 12:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1243bd0-46f1-5baf-b660-022079bee133 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1243bd0-46f1-5baf-b660-022079bee133 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b1243bd0-46f1-5baf-b660-022079bee133, identifier: NH24051
2026-03-30 12:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-30 12:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051
2026-03-30 12:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b1243bd0-46f1-5baf-b660-022079bee133 with identifier: NH24051 to the API
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:02:37Z',
'fuel_type': 'diesel',
'id': 'b1243bd0-46f1-5baf-b660-022079bee133',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH24051',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 266049,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-14',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2014}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Saving data for NH24051: {'auction_closing_time': 1774882957.0, 'created_time': 1774699581.155183, 'last_price_update_time': 1774874322.859091}
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH24051') HTTP/1.1" 204 0
2026-03-30 12:38:42 [auto1.it] INFO: Channel: 24h | Page: 86 | totalHits: 3598 | hits on page: 40
2026-03-30 12:38:42 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-30 12:38:42 [auto1.it] INFO: Scrape type for LU93439: 2
2026-03-30 12:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-30 12:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with scrape type 2
2026-03-30 12:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051, identifier: LU93439
2026-03-30 12:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-30 12:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439
2026-03-30 12:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f5b67b1-8b62-508a-bcb7-c0e377fb8051 with identifier: LU93439 to the API
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:07:14Z',
'fuel_type': 'diesel',
'id': '9f5b67b1-8b62-508a-bcb7-c0e377fb8051',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU93439',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 99861,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-31',
'seller_name': None,
'title': 'Fiat Punto 1.3 JTD Classic Active',
'transmission': 'manual',
'trim': 'Classic Active',
'year': 2010}
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-30 12:38:43 [auto1.it] INFO: Saving data for LU93439: {'auction_closing_time': 1774883234.0, 'created_time': 1774699619.446168, 'last_price_update_time': 1774874323.250531}
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU93439') HTTP/1.1" 204 0
2026-03-30 12:38:43 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-30 12:38:43 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-30 12:38:43 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-30 12:38:43 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-30 12:38:43 [auto1.it] INFO: Scrape type for PK33610: 2
2026-03-30 12:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-30 12:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 2
2026-03-30 12:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 2
2026-03-30 12:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3652c92f-d6ed-5635-a482-c31d8f9fc39d, identifier: PK33610
2026-03-30 12:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:38:43 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-30 12:38:43 [auto1.it] INFO: Scrape type for GC10643: 2
2026-03-30 12:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-30 12:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8833348-1720-55ca-b6c9-4f7063df27ca with scrape type 2
2026-03-30 12:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8833348-1720-55ca-b6c9-4f7063df27ca with scrape type 2
2026-03-30 12:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8833348-1720-55ca-b6c9-4f7063df27ca, identifier: GC10643
2026-03-30 12:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 12:38:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 12:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-03-30 12:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610 to the API
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:29:52Z',
'fuel_type': 'petrol',
'id': '3652c92f-d6ed-5635-a482-c31d8f9fc39d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK33610',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 26446,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active Pack',
'transmission': 'manual',
'trim': 'Active Pack',
'year': 2021}
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-30 12:38:43 [auto1.it] INFO: Saving data for PK33610: {'auction_closing_time': 1774884592.0, 'created_time': 1774699621.117402, 'last_price_update_time': 1774874323.88039}
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK33610') HTTP/1.1" 204 0
2026-03-30 12:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-30 12:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643
2026-03-30 12:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8833348-1720-55ca-b6c9-4f7063df27ca with identifier: GC10643 to the API
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:49Z',
'fuel_type': 'diesel',
'id': 'f8833348-1720-55ca-b6c9-4f7063df27ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC10643',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 115382,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-28',
'seller_name': None,
'title': 'Hyundai ix20 1.4 CRDi Xpossible',
'transmission': 'manual',
'trim': 'Xpossible',
'year': 2016}
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-30 12:38:44 [auto1.it] INFO: Saving data for GC10643: {'auction_closing_time': 1774883509.0, 'created_time': 1774699631.521492, 'last_price_update_time': 1774874324.268349}
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GC10643') HTTP/1.1" 204 0
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-30 12:38:44 [auto1.it] INFO: Scrape type for PR73005: 2
2026-03-30 12:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-30 12:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 226ea16f-8e4c-5c8c-8029-e732542d307f with scrape type 2
2026-03-30 12:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 226ea16f-8e4c-5c8c-8029-e732542d307f with scrape type 2
2026-03-30 12:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 226ea16f-8e4c-5c8c-8029-e732542d307f, identifier: PR73005
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-30 12:38:44 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-30 12:38:44 [auto1.it] INFO: Scrape type for VJ26511: 2
2026-03-30 12:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-30 12:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with scrape type 2
2026-03-30 12:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with scrape type 2
2026-03-30 12:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07, identifier: VJ26511
2026-03-30 12:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-30 12:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005
2026-03-30 12:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 226ea16f-8e4c-5c8c-8029-e732542d307f with identifier: PR73005 to the API
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:15:13Z',
'fuel_type': 'hybrid',
'id': '226ea16f-8e4c-5c8c-8029-e732542d307f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR73005',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 25721,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-07',
'seller_name': None,
'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2022}
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-30 12:38:44 [auto1.it] INFO: Saving data for PR73005: {'auction_closing_time': 1774883713.0, 'created_time': 1774699637.399187, 'last_price_update_time': 1774874324.772952}
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR73005') HTTP/1.1" 204 0
2026-03-30 12:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-30 12:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511
2026-03-30 12:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4e4cb87-df47-57e4-b8ad-6419a1fd3c07 with identifier: VJ26511 to the API
2026-03-30 12:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:07:56Z',
'fuel_type': 'diesel',
'id': 'b4e4cb87-df47-57e4-b8ad-6419a1fd3c07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ26511',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 162188,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-22',
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI Admired',
'transmission': 'manual',
'trim': 'Admired',
'year': 2013}
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-30 12:38:45 [auto1.it] INFO: Saving data for VJ26511: {'auction_closing_time': 1774883276.0, 'created_time': 1774699597.372339, 'last_price_update_time': 1774874325.157096}
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VJ26511') HTTP/1.1" 204 0
2026-03-30 12:38:45 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-30 12:38:45 [auto1.it] INFO: Scrape type for VU45167: 2
2026-03-30 12:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-30 12:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f35d65-c75a-544a-bcc6-29d77a5b267f with scrape type 2
2026-03-30 12:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f35d65-c75a-544a-bcc6-29d77a5b267f with scrape type 2
2026-03-30 12:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 30f35d65-c75a-544a-bcc6-29d77a5b267f, identifier: VU45167
2026-03-30 12:38:45 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-30 12:38:45 [auto1.it] INFO: Scrape type for UM38141: 2
2026-03-30 12:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-30 12:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d30fe5e-01e6-5e04-a30f-72906e911127 with scrape type 2
2026-03-30 12:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d30fe5e-01e6-5e04-a30f-72906e911127 with scrape type 2
2026-03-30 12:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4d30fe5e-01e6-5e04-a30f-72906e911127, identifier: UM38141
2026-03-30 12:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-30 12:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167
2026-03-30 12:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 30f35d65-c75a-544a-bcc6-29d77a5b267f with identifier: VU45167 to the API
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:12:04Z',
'fuel_type': 'diesel',
'id': '30f35d65-c75a-544a-bcc6-29d77a5b267f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU45167',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 175807,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2014}
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-30 12:38:45 [auto1.it] INFO: Saving data for VU45167: {'auction_closing_time': 1774883524.0, 'created_time': 1774699596.602416, 'last_price_update_time': 1774874325.700777}
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VU45167') HTTP/1.1" 204 0
2026-03-30 12:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-30 12:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141
2026-03-30 12:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d30fe5e-01e6-5e04-a30f-72906e911127 with identifier: UM38141 to the API
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:26:40Z',
'fuel_type': 'gas',
'id': '4d30fe5e-01e6-5e04-a30f-72906e911127',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM38141',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 344623,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-03',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 BIFuel Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-30 12:38:46 [auto1.it] INFO: Saving data for UM38141: {'auction_closing_time': 1774884400.0, 'created_time': 1774699594.280045, 'last_price_update_time': 1774874326.052307}
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM38141') HTTP/1.1" 204 0
2026-03-30 12:38:46 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-30 12:38:46 [auto1.it] INFO: Scrape type for YD14292: 2
2026-03-30 12:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-30 12:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with scrape type 2
2026-03-30 12:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with scrape type 2
2026-03-30 12:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff, identifier: YD14292
2026-03-30 12:38:46 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-30 12:38:46 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-30 12:38:46 [auto1.it] INFO: Scrape type for LD34697: 2
2026-03-30 12:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-30 12:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dba344c-9659-55ab-b03c-647479a30b0f with scrape type 2
2026-03-30 12:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dba344c-9659-55ab-b03c-647479a30b0f with scrape type 2
2026-03-30 12:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5dba344c-9659-55ab-b03c-647479a30b0f, identifier: LD34697
2026-03-30 12:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-30 12:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292
2026-03-30 12:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 538ddd9a-147f-5bdf-b06d-ef0bff55e2ff with identifier: YD14292 to the API
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:14:23Z',
'fuel_type': 'petrol',
'id': '538ddd9a-147f-5bdf-b06d-ef0bff55e2ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD14292',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 131881,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-27',
'seller_name': None,
'title': 'Audi Q5 2.0 TFSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2011}
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-30 12:38:46 [auto1.it] INFO: Saving data for YD14292: {'auction_closing_time': 1774883663.0, 'created_time': 1774699592.191417, 'last_price_update_time': 1774874326.605544}
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD14292') HTTP/1.1" 204 0
2026-03-30 12:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-30 12:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697
2026-03-30 12:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5dba344c-9659-55ab-b03c-647479a30b0f with identifier: LD34697 to the API
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:07:02Z',
'fuel_type': 'diesel',
'id': '5dba344c-9659-55ab-b03c-647479a30b0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD34697',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 96975,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.5 Blue-HDi Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Saving data for LD34697: {'auction_closing_time': 1774883222.0, 'created_time': 1774699626.144786, 'last_price_update_time': 1774874327.028052}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LD34697') HTTP/1.1" 204 0
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Scrape type for HC79760: 2
2026-03-30 12:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-30 12:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with scrape type 2
2026-03-30 12:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with scrape type 2
2026-03-30 12:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 125b1a7b-6637-556f-aa40-9f9e3f8626e4, identifier: HC79760
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-30 12:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-30 12:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760
2026-03-30 12:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 125b1a7b-6637-556f-aa40-9f9e3f8626e4 with identifier: HC79760 to the API
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:10:18Z',
'fuel_type': 'diesel',
'id': '125b1a7b-6637-556f-aa40-9f9e3f8626e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC79760',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 121314,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-29',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Saving data for HC79760: {'auction_closing_time': 1774883418.0, 'created_time': 1774699593.909936, 'last_price_update_time': 1774874327.443022}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HC79760') HTTP/1.1" 204 0
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Scrape type for AY38539: 2
2026-03-30 12:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-30 12:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with scrape type 2
2026-03-30 12:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with scrape type 2
2026-03-30 12:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 984e52a1-fc86-5f11-9a48-d70cb58b60a3, identifier: AY38539
2026-03-30 12:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-30 12:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539
2026-03-30 12:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 984e52a1-fc86-5f11-9a48-d70cb58b60a3 with identifier: AY38539 to the API
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:26:14Z',
'fuel_type': 'petrol',
'id': '984e52a1-fc86-5f11-9a48-d70cb58b60a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY38539',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 75736,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-09',
'seller_name': None,
'title': 'Hyundai i30 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2012}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Saving data for AY38539: {'auction_closing_time': 1774884374.0, 'created_time': 1774699635.236221, 'last_price_update_time': 1774874327.888341}
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AY38539') HTTP/1.1" 204 0
2026-03-30 12:38:47 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-30 12:38:47 [auto1.it] INFO: Scrape type for FN08703: 2
2026-03-30 12:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-30 12:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with scrape type 2
2026-03-30 12:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with scrape type 2
2026-03-30 12:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebd64a4d-f1d7-5b81-9670-d82009ea60d4, identifier: FN08703
2026-03-30 12:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-30 12:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703
2026-03-30 12:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebd64a4d-f1d7-5b81-9670-d82009ea60d4 with identifier: FN08703 to the API
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:56:13Z',
'fuel_type': 'petrol',
'id': 'ebd64a4d-f1d7-5b81-9670-d82009ea60d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN08703',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 144609,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Hyundai i20 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2014}
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-30 12:38:48 [auto1.it] INFO: Saving data for FN08703: {'auction_closing_time': 1774886173.0, 'created_time': 1774699643.151722, 'last_price_update_time': 1774874328.271246}
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN08703') HTTP/1.1" 204 0
2026-03-30 12:38:48 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-30 12:38:48 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-30 12:38:48 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-30 12:38:48 [auto1.it] INFO: Scrape type for WA74903: 2
2026-03-30 12:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-30 12:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with scrape type 2
2026-03-30 12:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with scrape type 2
2026-03-30 12:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310, identifier: WA74903
2026-03-30 12:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-30 12:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903
2026-03-30 12:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8eea0ba7-0e9c-5f13-b01c-723e3e34d310 with identifier: WA74903 to the API
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:58:46Z',
'fuel_type': 'diesel',
'id': '8eea0ba7-0e9c-5f13-b01c-723e3e34d310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA74903',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 153552,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.6 TDI Style BlueMotion',
'transmission': 'manual',
'trim': 'Style BlueMotion',
'year': 2017}
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-30 12:38:48 [auto1.it] INFO: Saving data for WA74903: {'auction_closing_time': 1774886326.0, 'created_time': 1774440448.950955, 'last_price_update_time': 1774874328.7666}
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA74903') HTTP/1.1" 204 0
2026-03-30 12:38:48 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-30 12:38:48 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-30 12:38:48 [auto1.it] INFO: Scrape type for RX99129: 2
2026-03-30 12:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-30 12:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with scrape type 2
2026-03-30 12:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with scrape type 2
2026-03-30 12:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318, identifier: RX99129
2026-03-30 12:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-30 12:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129
2026-03-30 12:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f6b60628-4f3c-5d4a-a89d-a2a00f9c5318 with identifier: RX99129 to the API
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:33:26Z',
'fuel_type': 'diesel',
'id': 'f6b60628-4f3c-5d4a-a89d-a2a00f9c5318',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX99129',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Connect',
'odometer': 49913,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-22',
'seller_name': None,
'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
'transmission': 'automatic',
'trim': 'Kasten Trend lang',
'year': 2023}
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-30 12:38:49 [auto1.it] INFO: Saving data for RX99129: {'auction_closing_time': 1774884806.0, 'created_time': 1774699638.279271, 'last_price_update_time': 1774874329.556198}
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX99129') HTTP/1.1" 204 0
2026-03-30 12:38:49 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-30 12:38:49 [auto1.it] INFO: Scrape type for EY62872: 2
2026-03-30 12:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-30 12:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0077dae7-9082-5831-b811-58838feecdff with scrape type 2
2026-03-30 12:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0077dae7-9082-5831-b811-58838feecdff with scrape type 2
2026-03-30 12:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0077dae7-9082-5831-b811-58838feecdff, identifier: EY62872
2026-03-30 12:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-30 12:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872
2026-03-30 12:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0077dae7-9082-5831-b811-58838feecdff with identifier: EY62872 to the API
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:23:00Z',
'fuel_type': 'diesel',
'id': '0077dae7-9082-5831-b811-58838feecdff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY62872',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 135743,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2017}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Saving data for EY62872: {'auction_closing_time': 1774884180.0, 'created_time': 1774699593.538643, 'last_price_update_time': 1774874330.068972}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EY62872') HTTP/1.1" 204 0
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Scrape type for EU57494: 2
2026-03-30 12:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-30 12:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with scrape type 2
2026-03-30 12:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with scrape type 2
2026-03-30 12:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9, identifier: EU57494
2026-03-30 12:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-30 12:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494
2026-03-30 12:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a8b502f-6ccc-5483-9df0-0972dbb8f3d9 with identifier: EU57494 to the API
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:20:05Z',
'fuel_type': 'hybrid',
'id': '4a8b502f-6ccc-5483-9df0-0972dbb8f3d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU57494',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 8019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-11',
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Lounge',
'transmission': 'automatic',
'trim': '2WD Lounge',
'year': 2022}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Saving data for EU57494: {'auction_closing_time': 1774884005.0, 'created_time': 1774699589.88535, 'last_price_update_time': 1774874330.480742}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU57494') HTTP/1.1" 204 0
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Scrape type for EG76959: 2
2026-03-30 12:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-30 12:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414ee5a8-9966-5155-a7ea-6743de9d969e with scrape type 2
2026-03-30 12:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414ee5a8-9966-5155-a7ea-6743de9d969e with scrape type 2
2026-03-30 12:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 414ee5a8-9966-5155-a7ea-6743de9d969e, identifier: EG76959
2026-03-30 12:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-30 12:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959
2026-03-30 12:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 414ee5a8-9966-5155-a7ea-6743de9d969e with identifier: EG76959 to the API
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:32:00Z',
'fuel_type': 'petrol',
'id': '414ee5a8-9966-5155-a7ea-6743de9d969e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG76959',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 115364,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Saving data for EG76959: {'auction_closing_time': 1774884720.0, 'created_time': 1774699622.750078, 'last_price_update_time': 1774874330.92132}
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EG76959') HTTP/1.1" 204 0
2026-03-30 12:38:50 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-30 12:38:50 [auto1.it] INFO: Scrape type for EW38815: 2
2026-03-30 12:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-30 12:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d472da71-a6c3-5c89-bdce-60574e916ef6 with scrape type 2
2026-03-30 12:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d472da71-a6c3-5c89-bdce-60574e916ef6 with scrape type 2
2026-03-30 12:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d472da71-a6c3-5c89-bdce-60574e916ef6, identifier: EW38815
2026-03-30 12:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-30 12:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815
2026-03-30 12:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d472da71-a6c3-5c89-bdce-60574e916ef6 with identifier: EW38815 to the API
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:43:16Z',
'fuel_type': 'gas',
'id': 'd472da71-a6c3-5c89-bdce-60574e916ef6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW38815',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 149857,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-30',
'seller_name': None,
'title': 'Ford C-Max 1.6 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-30 12:38:51 [auto1.it] INFO: Saving data for EW38815: {'auction_closing_time': 1774885396.0, 'created_time': 1774699633.679155, 'last_price_update_time': 1774874331.363602}
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW38815') HTTP/1.1" 204 0
2026-03-30 12:38:51 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC51898%27 HTTP/1.1" 200 None
2026-03-30 12:38:51 [auto1.it] INFO: Scrape type for RC51898: 0
2026-03-30 12:38:51 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-30 12:38:51 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-30 12:38:51 [auto1.it] INFO: Scrape type for EX32240: 2
2026-03-30 12:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-30 12:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb2ce7c-b744-5815-982d-b1f51c9d812b with scrape type 2
2026-03-30 12:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb2ce7c-b744-5815-982d-b1f51c9d812b with scrape type 2
2026-03-30 12:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dcb2ce7c-b744-5815-982d-b1f51c9d812b, identifier: EX32240
2026-03-30 12:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-30 12:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240
2026-03-30 12:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dcb2ce7c-b744-5815-982d-b1f51c9d812b with identifier: EX32240 to the API
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:31:58Z',
'fuel_type': 'diesel',
'id': 'dcb2ce7c-b744-5815-982d-b1f51c9d812b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX32240',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 222668,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-30',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-30 12:38:51 [auto1.it] INFO: Saving data for EX32240: {'auction_closing_time': 1774884718.0, 'created_time': 1774699630.910071, 'last_price_update_time': 1774874331.7986}
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EX32240') HTTP/1.1" 204 0
2026-03-30 12:38:51 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-30 12:38:51 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-30 12:38:51 [auto1.it] INFO: Scrape type for ZD86423: 2
2026-03-30 12:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-30 12:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with scrape type 2
2026-03-30 12:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with scrape type 2
2026-03-30 12:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee0ce13e-15ea-593a-b11d-05bedfd3bf68, identifier: ZD86423
2026-03-30 12:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-30 12:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423
2026-03-30 12:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee0ce13e-15ea-593a-b11d-05bedfd3bf68 with identifier: ZD86423 to the API
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:18Z',
'fuel_type': 'petrol',
'id': 'ee0ce13e-15ea-593a-b11d-05bedfd3bf68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD86423',
'listing': 'auction',
'make': 'Renault',
'model': 'Modus',
'odometer': 154923,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-29',
'seller_name': None,
'title': 'Renault Modus 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2009}
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-30 12:38:52 [auto1.it] INFO: Saving data for ZD86423: {'auction_closing_time': 1774886238.0, 'created_time': 1774699630.225043, 'last_price_update_time': 1774874332.296215}
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD86423') HTTP/1.1" 204 0
2026-03-30 12:38:52 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-30 12:38:52 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-30 12:38:52 [auto1.it] INFO: Scrape type for GD51545: 2
2026-03-30 12:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-30 12:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbdc37d8-83c1-576e-9ad5-1a040d503d19 with scrape type 2
2026-03-30 12:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbdc37d8-83c1-576e-9ad5-1a040d503d19 with scrape type 2
2026-03-30 12:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dbdc37d8-83c1-576e-9ad5-1a040d503d19, identifier: GD51545
2026-03-30 12:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-30 12:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545
2026-03-30 12:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dbdc37d8-83c1-576e-9ad5-1a040d503d19 with identifier: GD51545 to the API
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'petrol',
'id': 'dbdc37d8-83c1-576e-9ad5-1a040d503d19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD51545',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 101688,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-30 12:38:52 [auto1.it] INFO: Saving data for GD51545: {'auction_closing_time': 1774885289.0, 'created_time': 1774699613.468194, 'last_price_update_time': 1774874332.720309}
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD51545') HTTP/1.1" 204 0
2026-03-30 12:38:52 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-30 12:38:52 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-30 12:38:52 [auto1.it] INFO: Scrape type for UD61440: 2
2026-03-30 12:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-30 12:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e7dcd7d-102b-5040-8b00-8247980db4a5 with scrape type 2
2026-03-30 12:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e7dcd7d-102b-5040-8b00-8247980db4a5 with scrape type 2
2026-03-30 12:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e7dcd7d-102b-5040-8b00-8247980db4a5, identifier: UD61440
2026-03-30 12:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-30 12:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440
2026-03-30 12:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e7dcd7d-102b-5040-8b00-8247980db4a5 with identifier: UD61440 to the API
2026-03-30 12:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:00:02Z',
'fuel_type': 'diesel',
'id': '1e7dcd7d-102b-5040-8b00-8247980db4a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD61440',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 448237,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-19',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'manual',
'trim': 'Sport & Style 4Motion',
'year': 2009}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Saving data for UD61440: {'auction_closing_time': 1774882802.0, 'created_time': 1774699612.32968, 'last_price_update_time': 1774874333.134966}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD61440') HTTP/1.1" 204 0
2026-03-30 12:38:53 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Scrape type for EP46313: 2
2026-03-30 12:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-30 12:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with scrape type 2
2026-03-30 12:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with scrape type 2
2026-03-30 12:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b, identifier: EP46313
2026-03-30 12:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-30 12:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313
2026-03-30 12:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 271d4042-2b7b-5c1c-a9b4-f94a4651c34b with identifier: EP46313 to the API
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:19:49Z',
'fuel_type': 'diesel',
'id': '271d4042-2b7b-5c1c-a9b4-f94a4651c34b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP46313',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 234255,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-24',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Core 2WD',
'transmission': 'automatic',
'trim': 'Core 2WD',
'year': 2022}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Saving data for EP46313: {'auction_closing_time': 1774883989.0, 'created_time': 1774343191.116189, 'last_price_update_time': 1774874333.551143}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP46313') HTTP/1.1" 204 0
2026-03-30 12:38:53 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Scrape type for NB70789: 2
2026-03-30 12:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-30 12:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with scrape type 2
2026-03-30 12:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with scrape type 2
2026-03-30 12:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58, identifier: NB70789
2026-03-30 12:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-30 12:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789
2026-03-30 12:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a0bd5fb-40ab-5cdd-804d-90031e1efb58 with identifier: NB70789 to the API
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:36:35Z',
'fuel_type': 'diesel',
'id': '3a0bd5fb-40ab-5cdd-804d-90031e1efb58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB70789',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 328181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-17',
'seller_name': None,
'title': 'BMW X4 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Saving data for NB70789: {'auction_closing_time': 1774884995.0, 'created_time': 1774699611.989132, 'last_price_update_time': 1774874333.945494}
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NB70789') HTTP/1.1" 204 0
2026-03-30 12:38:53 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-30 12:38:53 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-30 12:38:53 [auto1.it] INFO: Scrape type for LS68308: 2
2026-03-30 12:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-30 12:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be04f711-f980-59c2-9ef7-f4aa908022f7 with scrape type 2
2026-03-30 12:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be04f711-f980-59c2-9ef7-f4aa908022f7 with scrape type 2
2026-03-30 12:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: be04f711-f980-59c2-9ef7-f4aa908022f7, identifier: LS68308
2026-03-30 12:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-30 12:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308
2026-03-30 12:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: be04f711-f980-59c2-9ef7-f4aa908022f7 with identifier: LS68308 to the API
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:22:27Z',
'fuel_type': 'diesel',
'id': 'be04f711-f980-59c2-9ef7-f4aa908022f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS68308',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 183528,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-04',
'seller_name': None,
'title': 'Nissan Pulsar 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2015}
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-30 12:38:54 [auto1.it] INFO: Saving data for LS68308: {'auction_closing_time': 1774884147.0, 'created_time': 1774699610.856189, 'last_price_update_time': 1774874334.345316}
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LS68308') HTTP/1.1" 204 0
2026-03-30 12:38:54 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-30 12:38:54 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-30 12:38:54 [auto1.it] INFO: Scrape type for HU17700: 2
2026-03-30 12:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-30 12:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with scrape type 2
2026-03-30 12:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with scrape type 2
2026-03-30 12:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfc9795f-bc6f-5e47-ac08-3e603016d0d1, identifier: HU17700
2026-03-30 12:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-30 12:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700
2026-03-30 12:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfc9795f-bc6f-5e47-ac08-3e603016d0d1 with identifier: HU17700 to the API
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:58:05Z',
'fuel_type': 'petrol',
'id': 'bfc9795f-bc6f-5e47-ac08-3e603016d0d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU17700',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 131664,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-02',
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-30 12:38:54 [auto1.it] INFO: Saving data for HU17700: {'auction_closing_time': 1774886285.0, 'created_time': 1773136444.065713, 'last_price_update_time': 1774874334.78085}
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU17700') HTTP/1.1" 204 0
2026-03-30 12:39:04 [scrapy.extensions.logstats] INFO: Crawled 300 pages (at 5 pages/min), scraped 325 items (at 100 items/min)
2026-03-30 12:39:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:39:18 [auto1.it] INFO: Channel: 24h | Page: 87 | totalHits: 3598 | hits on page: 40
2026-03-30 12:39:18 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-30 12:39:18 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-30 12:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-30 12:39:18 [auto1.it] INFO: Scrape type for BC13106: 2
2026-03-30 12:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-30 12:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ce2ae7-4284-57be-bf98-6054721a526e with scrape type 2
2026-03-30 12:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ce2ae7-4284-57be-bf98-6054721a526e with scrape type 2
2026-03-30 12:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 36ce2ae7-4284-57be-bf98-6054721a526e, identifier: BC13106
2026-03-30 12:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-30 12:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106
2026-03-30 12:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 36ce2ae7-4284-57be-bf98-6054721a526e with identifier: BC13106 to the API
2026-03-30 12:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:19:43Z',
'fuel_type': 'petrol',
'id': '36ce2ae7-4284-57be-bf98-6054721a526e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC13106',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 128598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-29',
'seller_name': None,
'title': 'Opel Zafira 1.6 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2010}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Saving data for BC13106: {'auction_closing_time': 1774883983.0, 'created_time': 1774699615.21616, 'last_price_update_time': 1774874359.018594}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC13106') HTTP/1.1" 204 0
2026-03-30 12:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:39:19 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Scrape type for SS75136: 2
2026-03-30 12:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-30 12:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f029de87-54cc-51b1-8c8d-319621cad535 with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f029de87-54cc-51b1-8c8d-319621cad535 with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f029de87-54cc-51b1-8c8d-319621cad535, identifier: SS75136
2026-03-30 12:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-30 12:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136
2026-03-30 12:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f029de87-54cc-51b1-8c8d-319621cad535 with identifier: SS75136 to the API
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:18:58Z',
'fuel_type': 'diesel',
'id': 'f029de87-54cc-51b1-8c8d-319621cad535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS75136',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 168046,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-27',
'seller_name': None,
'title': 'Jeep Compass 2.2 CRD Limited 4x4',
'transmission': 'manual',
'trim': 'Limited 4x4',
'year': 2011}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Saving data for SS75136: {'auction_closing_time': 1774883938.0, 'created_time': 1774699634.108063, 'last_price_update_time': 1774874359.387849}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS75136') HTTP/1.1" 204 0
2026-03-30 12:39:19 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-30 12:39:19 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Scrape type for FW12151: 2
2026-03-30 12:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-30 12:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f93761-165c-58a3-af1e-21ed0d6f13ab with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f93761-165c-58a3-af1e-21ed0d6f13ab with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 50f93761-165c-58a3-af1e-21ed0d6f13ab, identifier: FW12151
2026-03-30 12:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-30 12:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151
2026-03-30 12:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 50f93761-165c-58a3-af1e-21ed0d6f13ab with identifier: FW12151 to the API
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:00:24Z',
'fuel_type': 'petrol',
'id': '50f93761-165c-58a3-af1e-21ed0d6f13ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW12151',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 89240,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-19',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2010}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Saving data for FW12151: {'auction_closing_time': 1774882824.0, 'created_time': 1774699610.212695, 'last_price_update_time': 1774874359.787117}
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FW12151') HTTP/1.1" 204 0
2026-03-30 12:39:19 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-30 12:39:19 [auto1.it] INFO: Scrape type for SD66994: 2
2026-03-30 12:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-30 12:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with scrape type 2
2026-03-30 12:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2, identifier: SD66994
2026-03-30 12:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-30 12:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994
2026-03-30 12:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecfc837f-3707-5d5d-a0b0-975b2ea87ef2 with identifier: SD66994 to the API
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:51:57Z',
'fuel_type': 'petrol',
'id': 'ecfc837f-3707-5d5d-a0b0-975b2ea87ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD66994',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 33069,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-20',
'seller_name': None,
'title': 'Hyundai i10 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-30 12:39:20 [auto1.it] INFO: Saving data for SD66994: {'auction_closing_time': 1774885917.0, 'created_time': 1774699620.577812, 'last_price_update_time': 1774874360.177527}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SD66994') HTTP/1.1" 204 0
2026-03-30 12:39:20 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-30 12:39:20 [auto1.it] INFO: Scrape type for LB50046: 2
2026-03-30 12:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-30 12:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with scrape type 2
2026-03-30 12:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with scrape type 2
2026-03-30 12:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9, identifier: LB50046
2026-03-30 12:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-30 12:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046
2026-03-30 12:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03d9f1cd-13c8-5a12-a075-fc1c6be123f9 with identifier: LB50046 to the API
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:03:25Z',
'fuel_type': 'diesel',
'id': '03d9f1cd-13c8-5a12-a075-fc1c6be123f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB50046',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 160217,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-09',
'seller_name': None,
'title': 'Skoda Yeti 1.6 TDI Ambiton GreenLine',
'transmission': 'manual',
'trim': 'Ambiton GreenLine',
'year': 2013}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-30 12:39:20 [auto1.it] INFO: Saving data for LB50046: {'auction_closing_time': 1774883005.0, 'created_time': 1774699621.507474, 'last_price_update_time': 1774874360.558984}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB50046') HTTP/1.1" 204 0
2026-03-30 12:39:20 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-30 12:39:20 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-30 12:39:20 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-30 12:39:20 [auto1.it] INFO: Scrape type for MX93098: 2
2026-03-30 12:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-30 12:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a40b1f-769c-5063-91c5-8404dd3fb1bc with scrape type 2
2026-03-30 12:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a40b1f-769c-5063-91c5-8404dd3fb1bc with scrape type 2
2026-03-30 12:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 21a40b1f-769c-5063-91c5-8404dd3fb1bc, identifier: MX93098
2026-03-30 12:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-30 12:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098
2026-03-30 12:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 21a40b1f-769c-5063-91c5-8404dd3fb1bc with identifier: MX93098 to the API
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:48:05Z',
'fuel_type': 'petrol',
'id': '21a40b1f-769c-5063-91c5-8404dd3fb1bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX93098',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 255397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-31',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-30 12:39:20 [auto1.it] INFO: Saving data for MX93098: {'auction_closing_time': 1774885685.0, 'created_time': 1774699617.636463, 'last_price_update_time': 1774874360.990255}
2026-03-30 12:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MX93098') HTTP/1.1" 204 0
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-30 12:39:21 [auto1.it] INFO: Scrape type for VK29965: 2
2026-03-30 12:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-30 12:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fe6e99e-badc-5a01-b97a-b1995e889268 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fe6e99e-badc-5a01-b97a-b1995e889268 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3fe6e99e-badc-5a01-b97a-b1995e889268, identifier: VK29965
2026-03-30 12:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-30 12:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965
2026-03-30 12:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3fe6e99e-badc-5a01-b97a-b1995e889268 with identifier: VK29965 to the API
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:36:46Z',
'fuel_type': 'diesel',
'id': '3fe6e99e-badc-5a01-b97a-b1995e889268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK29965',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 115900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-28',
'seller_name': None,
'title': 'Volkswagen Amarok 2.0 TDI Life Doppelkabine 4Motion',
'transmission': 'automatic',
'trim': 'Life Doppelkabine 4Motion',
'year': 2023}
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-30 12:39:21 [auto1.it] INFO: Saving data for VK29965: {'auction_closing_time': 1774885006.0, 'created_time': 1774699634.505205, 'last_price_update_time': 1774874361.382554}
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VK29965') HTTP/1.1" 204 0
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-30 12:39:21 [auto1.it] INFO: Scrape type for WG00273: 2
2026-03-30 12:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-30 12:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6896d477-cffe-57f4-8204-fba01dc762e5 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6896d477-cffe-57f4-8204-fba01dc762e5 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6896d477-cffe-57f4-8204-fba01dc762e5, identifier: WG00273
2026-03-30 12:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-30 12:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273
2026-03-30 12:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6896d477-cffe-57f4-8204-fba01dc762e5 with identifier: WG00273 to the API
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:34:02Z',
'fuel_type': 'diesel',
'id': '6896d477-cffe-57f4-8204-fba01dc762e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG00273',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 252607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-30',
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2009}
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-30 12:39:21 [auto1.it] INFO: Saving data for WG00273: {'auction_closing_time': 1774884842.0, 'created_time': 1774699618.312595, 'last_price_update_time': 1774874361.848748}
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WG00273') HTTP/1.1" 204 0
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-30 12:39:21 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-30 12:39:21 [auto1.it] INFO: Scrape type for VB56015: 2
2026-03-30 12:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-30 12:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a43274-98c5-525d-99d7-bd65dbd988d3 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a43274-98c5-525d-99d7-bd65dbd988d3 with scrape type 2
2026-03-30 12:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87a43274-98c5-525d-99d7-bd65dbd988d3, identifier: VB56015
2026-03-30 12:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-30 12:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015
2026-03-30 12:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 87a43274-98c5-525d-99d7-bd65dbd988d3 with identifier: VB56015 to the API
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:04:41Z',
'fuel_type': 'diesel',
'id': '87a43274-98c5-525d-99d7-bd65dbd988d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB56015',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 137793,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-28',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Saving data for VB56015: {'auction_closing_time': 1774883081.0, 'created_time': 1774699619.065211, 'last_price_update_time': 1774874362.24013}
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB56015') HTTP/1.1" 204 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for RK78436: 2
2026-03-30 12:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-30 12:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with scrape type 2
2026-03-30 12:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with scrape type 2
2026-03-30 12:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae, identifier: RK78436
2026-03-30 12:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-30 12:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436
2026-03-30 12:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c16c40ca-e976-5dea-9dd6-99afe4b3c1ae with identifier: RK78436 to the API
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:04:35Z',
'fuel_type': 'petrol',
'id': 'c16c40ca-e976-5dea-9dd6-99afe4b3c1ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK78436',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 219791,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-30',
'seller_name': None,
'title': 'Citroen C3 1.1 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2009}
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Saving data for RK78436: {'auction_closing_time': 1774883075.0, 'created_time': 1774699625.345102, 'last_price_update_time': 1774874362.613221}
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK78436') HTTP/1.1" 204 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for HW36660: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for HR61031: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for GX37056: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for SP24974: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for WU48756: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for FV28373: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for WM91137: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for BU89130: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for JB83443: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for MR74044: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for RU74019: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for NY06096: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for DD11193: 0
2026-03-30 12:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:39:22 [auto1.it] INFO: Channel: 24h | Page: 88 | totalHits: 3598 | hits on page: 40
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-30 12:39:22 [auto1.it] INFO: Scrape type for TU55073: 0
2026-03-30 12:39:22 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for JC52693: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for BA37529: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for PR63683: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for KC74563: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for MB22824: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for NW35507: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for AG64342: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for RC92896: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for WK68121: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for MM70792: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for VP67579: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for VM60926: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for RY72509: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for UE94474: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for AP90035: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for BY89134: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for MU21056: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for XE56181: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for CP34925: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for UB84582: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for CB28979: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for RG05236: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for MN63848: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for GC15950: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for YR71782: 0
2026-03-30 12:39:23 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-30 12:39:23 [auto1.it] INFO: Scrape type for RX70685: 0
2026-03-30 12:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:40:04 [scrapy.extensions.logstats] INFO: Crawled 302 pages (at 2 pages/min), scraped 335 items (at 10 items/min)
2026-03-30 12:40:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:41:04 [scrapy.extensions.logstats] INFO: Crawled 302 pages (at 0 pages/min), scraped 335 items (at 0 items/min)
2026-03-30 12:41:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:41:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.002(s), this was the 1st time calling it.
2026-03-30 12:41:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.921736535106355 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 12:41:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 12:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:41:47 [auto1.it] INFO: Channel: 24h | Page: 89 | totalHits: 3600 | hits on page: 40
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for YR71782: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for RX70685: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for JP42061: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for PR59695: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for YC40082: 2
2026-03-30 12:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-30 12:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4557617-4b44-5adc-99d6-a74dd5a5ce51 with scrape type 2
2026-03-30 12:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4557617-4b44-5adc-99d6-a74dd5a5ce51 with scrape type 2
2026-03-30 12:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4557617-4b44-5adc-99d6-a74dd5a5ce51, identifier: YC40082
2026-03-30 12:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-30 12:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082
2026-03-30 12:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4557617-4b44-5adc-99d6-a74dd5a5ce51 with identifier: YC40082 to the API
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:09:40Z',
'fuel_type': 'diesel',
'id': 'd4557617-4b44-5adc-99d6-a74dd5a5ce51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC40082',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 97627,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Saving data for YC40082: {'auction_closing_time': 1774883380.0, 'created_time': 1774688796.031427, 'last_price_update_time': 1774874507.644197}
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YC40082') HTTP/1.1" 204 0
2026-03-30 12:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for AL09653: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for DK55043: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for NU26591: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for UB42424: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for RV63380: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for JE70672: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for KL44785: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for TU59167: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for TD04886: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for NK26905: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for EP64063: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for DP98022: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-30 12:41:47 [auto1.it] INFO: Scrape type for TZ57511: 0
2026-03-30 12:41:47 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for XF75286: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for YD21144: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for JC99655: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for YN59096: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for PC10641: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for MH04778: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for UW00940: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for CR16346: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for PD21393: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for XK62729: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-30 12:41:48 [auto1.it] INFO: Scrape type for BD17279: 0
2026-03-30 12:41:48 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-30 12:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:41:58 [auto1.it] INFO: Channel: 24h | Page: 90 | totalHits: 3600 | hits on page: 40
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for PZ74443: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for DF91853: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for TR54078: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for LG70821: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for PD30072: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for PN93360: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for GP46420: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for DX75497: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for CJ50775: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for KR24813: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for KK99486: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for XW14976: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for CV32353: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-30 12:41:58 [auto1.it] INFO: Scrape type for YE49798: 0
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-30 12:41:58 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-30 12:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-30 12:41:59 [auto1.it] INFO: Scrape type for UL30423: 0
2026-03-30 12:41:59 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-30 12:41:59 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-30 12:41:59 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-30 12:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-30 12:41:59 [auto1.it] INFO: Scrape type for SW75734: 0
2026-03-30 12:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:42:04 [scrapy.extensions.logstats] INFO: Crawled 304 pages (at 2 pages/min), scraped 336 items (at 1 items/min)
2026-03-30 12:42:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-30 12:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:42:07 [auto1.it] INFO: Channel: 24h | Page: 91 | totalHits: 3600 | hits on page: 0
2026-03-30 12:42:07 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:42:07 [auto1.it] INFO: auto1.it Batch config: batch 2/2
2026-03-30 12:42:07 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 40, <ScrapeType.BATCH_SKIPPED: 5>: 34}
2026-03-30 12:42:07 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (336 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_23_2026-03-30T12_05_00.jl
2026-03-30 12:42:07 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1417974,
'downloader/request_count': 746,
'downloader/request_method_count/GET': 653,
'downloader/request_method_count/POST': 93,
'downloader/response_bytes': 131607725,
'downloader/response_count': 746,
'downloader/response_status_count/200': 746,
'dupefilter/filtered': 5,
'elapsed_time_seconds': 2223.393754,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 12, 42, 7, 554615, tzinfo=datetime.timezone.utc),
'item_scraped_count': 336,
'log_count/DEBUG': 10982,
'log_count/INFO': 12069,
'memusage/max': 172171264,
'memusage/startup': 148213760,
'photo_download_count': 441,
'request_depth_max': 94,
'response_received_count': 305,
'scheduler/dequeued': 746,
'scheduler/dequeued/memory': 746,
'scheduler/enqueued': 746,
'scheduler/enqueued/memory': 746,
'scrape_type/batch_skipped': 1807,
'scrape_type/new': 105,
'scrape_type/price_update': 231,
'scrape_type/skipped': 1492,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 347,
'scrapy-zyte-api/error_ratio': 0.12103746397694524,
'scrapy-zyte-api/errors': 42,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 42,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 12.167434975714045,
'scrapy-zyte-api/mean_response_seconds': 12.215725800761435,
'scrapy-zyte-api/processed': 305,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 305,
'scrapy-zyte-api/request_args/experimental.requestCookies': 304,
'scrapy-zyte-api/request_args/experimental.responseCookies': 305,
'scrapy-zyte-api/request_args/httpRequestBody': 93,
'scrapy-zyte-api/request_args/httpRequestMethod': 93,
'scrapy-zyte-api/request_args/httpResponseBody': 305,
'scrapy-zyte-api/request_args/httpResponseHeaders': 305,
'scrapy-zyte-api/request_args/sessionContext': 305,
'scrapy-zyte-api/request_args/url': 305,
'scrapy-zyte-api/status_codes/0': 42,
'scrapy-zyte-api/status_codes/200': 305,
'scrapy-zyte-api/success': 305,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 3640,
'source/total_available': 3600,
'start_time': datetime.datetime(2026, 3, 30, 12, 5, 4, 160861, tzinfo=datetime.timezone.utc)}
2026-03-30 12:42:07 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:42:07 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f60127c6450>
2026-03-30 12:42:07 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f6012852d10>