2026-03-28 11:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 11:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 11:00:04 [auto1.es] INFO: Batch mode enabled: batch 1/2
2026-03-28 11:00:04 [auto1.es] INFO: Starting spider auto1.es
2026-03-28 11:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 11:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 11:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 11:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 11:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 2a82cf33a7d8c06d
2026-03-28 11:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 11:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_21_2026-03-28T11_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 11:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 11:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 11:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 11:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-28 11:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 11:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 11:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 11:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 11:00:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 11:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 11:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 11:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 11:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 11:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 11:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 11:00:15 [auto1.es] INFO: Channel: 24h | Page: 0 | totalHits: 2548 | hits on page: 40
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ15822%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for EJ15822: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW93745%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for PW93745: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW31062%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for RW31062: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP60269%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for XP60269: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG45325%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for WG45325: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for MD68479: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ63273%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for LJ63273: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX05735%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for LX05735: 1
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 11:00:15 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.es] INFO: Scrape type for UP08006: 2
2026-03-28 11:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-28 11:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a09408-3e64-5977-9dde-0ec17d510ef0 with scrape type 2
2026-03-28 11:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a09408-3e64-5977-9dde-0ec17d510ef0 with scrape type 2
2026-03-28 11:00:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15a09408-3e64-5977-9dde-0ec17d510ef0, identifier: UP08006
2026-03-28 11:00:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 11:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 11:00:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006
2026-03-28 11:00:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15a09408-3e64-5977-9dde-0ec17d510ef0 with identifier: UP08006 to the API
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:12Z',
 'fuel_type': 'petrol',
 'id': '15a09408-3e64-5977-9dde-0ec17d510ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP08006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 182549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.es] INFO: Saving data for UP08006: {'auction_closing_time': 1774886172.0, 'created_time': 1773432310.696511, 'last_price_update_time': 1774695616.349626}
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP08006') HTTP/1.1" 204 0
2026-03-28 11:00:16 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP47288%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.es] INFO: Scrape type for AP47288: 1
2026-03-28 11:00:16 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG51857%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.es] INFO: Scrape type for EG51857: 1
2026-03-28 11:00:16 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS53334%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.es] INFO: Scrape type for TS53334: 1
2026-03-28 11:00:16 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 11:00:16 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-28 11:00:16 [auto1.es] INFO: Scrape type for TW94946: 2
2026-03-28 11:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-28 11:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf8b380-754a-554a-842f-ebb4023ee0d4 with scrape type 2
2026-03-28 11:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abf8b380-754a-554a-842f-ebb4023ee0d4, identifier: TW94946
2026-03-28 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946
2026-03-28 11:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: abf8b380-754a-554a-842f-ebb4023ee0d4 with identifier: TW94946 to the API
2026-03-28 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:25:25Z',
 'fuel_type': 'diesel',
 'id': 'abf8b380-754a-554a-842f-ebb4023ee0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW94946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 108969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-28',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2007}
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-28 11:00:17 [auto1.es] INFO: Saving data for TW94946: {'auction_closing_time': 1774884325.0, 'created_time': 1774015595.87794, 'last_price_update_time': 1774695617.96282}
2026-03-28 11:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW94946') HTTP/1.1" 204 0
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE70928%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.es] INFO: Scrape type for KE70928: 1
2026-03-28 11:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX30017%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.es] INFO: Scrape type for HX30017: 1
2026-03-28 11:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY19830%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.es] INFO: Scrape type for SY19830: 1
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-28 11:00:18 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.es] INFO: Scrape type for RF07402: 2
2026-03-28 11:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-28 11:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with scrape type 2
2026-03-28 11:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ed9aced-5f26-5a9e-9b88-a649a22c4869, identifier: RF07402
2026-03-28 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402
2026-03-28 11:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5ed9aced-5f26-5a9e-9b88-a649a22c4869 with identifier: RF07402 to the API
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:16:17Z',
 'fuel_type': 'hybrid',
 'id': '5ed9aced-5f26-5a9e-9b88-a649a22c4869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF07402',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 199517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2017}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-28 11:00:18 [auto1.es] INFO: Saving data for RF07402: {'auction_closing_time': 1774883777.0, 'created_time': 1773410560.602644, 'last_price_update_time': 1774695618.915184}
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RF07402') HTTP/1.1" 204 0
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR94321%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for FR94321: 1
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW93745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ15822/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP60269/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD68479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ63273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG45325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW31062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [auto1.es] INFO: Channel: 24h | Page: 1 | totalHits: 2548 | hits on page: 40
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA24744%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for UA24744: 1
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: MB84722
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: LJ76741
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: EJ15822
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: US29597
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ67875%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for NJ67875: 1
2026-03-28 11:00:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/EJ15822/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: MY16878
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: SR36141
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: PW93745
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: RW31062
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: UB86701
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: XP60269
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: KL17964
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: NM08693
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: MM24927
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: WG45325
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: MD68479
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: AZ60367
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: LJ63273
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: EH03748
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: GF33961
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: LX05735
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: FX69665
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: NV64390
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: UH53722
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: UP08006
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP08006%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for UP08006: 0
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: AP47288
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: EG51857
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: TS53334
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: HP31470
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: TW94946
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW94946%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for TW94946: 0
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: KE70928
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: HX30017
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: PE66788
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: WA65207
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: SY19830
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: RR07700
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: RF07402
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF07402%27 HTTP/1.1" 200 None
2026-03-28 11:00:19 [auto1.es] INFO: Scrape type for RF07402: 0
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: FR94321
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: UA24744
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: US29597
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: NJ67875
2026-03-28 11:00:19 [auto1.es] INFO: Found listing with ID: XF82752
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX05735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY19830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG51857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX30017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS53334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP47288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [auto1.es] INFO: Channel: 24h | Page: 2 | totalHits: 2548 | hits on page: 40
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: RK77233
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: YJ22884
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.es] INFO: Scrape type for YJ22884: 1
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: VV48329
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48329%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.es] INFO: Scrape type for VV48329: 1
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE70928/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: NR06421
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: UE40961
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: KH51643
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH51643%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.es] INFO: Scrape type for KH51643: 1
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: VK88655
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: LX19850
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: VY33491
2026-03-28 11:00:20 [auto1.es] INFO: Found listing with ID: MK70823
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.es] INFO: Scrape type for MK70823: 2
2026-03-28 11:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-28 11:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 2
2026-03-28 11:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043be3b6-9f94-5190-9dea-94f99414cd15 with scrape type 2
2026-03-28 11:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 043be3b6-9f94-5190-9dea-94f99414cd15, identifier: MK70823
2026-03-28 11:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 11:00:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823
2026-03-28 11:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 043be3b6-9f94-5190-9dea-94f99414cd15 with identifier: MK70823 to the API
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'diesel',
 'id': '043be3b6-9f94-5190-9dea-94f99414cd15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK70823',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 89468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK70823%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.es] INFO: Saving data for MK70823: {'auction_closing_time': 1774885903.0, 'created_time': 1773399792.831716, 'last_price_update_time': 1774695620.893011}
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK70823') HTTP/1.1" 204 0
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: WJ13987
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: CV66475
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV66475%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for CV66475: 1
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: WV13003
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for WV13003: 2
2026-03-28 11:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-28 11:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08fa0f52-780c-563f-be19-5092d0863191 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08fa0f52-780c-563f-be19-5092d0863191 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08fa0f52-780c-563f-be19-5092d0863191, identifier: WV13003
2026-03-28 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UA24744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR94321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-28 11:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003
2026-03-28 11:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08fa0f52-780c-563f-be19-5092d0863191 with identifier: WV13003 to the API
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'diesel',
 'id': '08fa0f52-780c-563f-be19-5092d0863191',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV13003',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 356404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-27',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV13003%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Saving data for WV13003: {'auction_closing_time': 1774882912.0, 'created_time': 1773410452.544435, 'last_price_update_time': 1774695621.562759}
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WV13003') HTTP/1.1" 204 0
2026-03-28 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: RU20773
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU20773%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for RU20773: 1
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: DX72954
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX72954%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for DX72954: 1
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: VA33750
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA33750%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for VA33750: 1
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: SR52978
2026-03-28 11:00:21 [auto1.es] INFO: Found listing with ID: BA23720
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-28 11:00:21 [auto1.es] INFO: Scrape type for BA23720: 2
2026-03-28 11:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-28 11:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with scrape type 2
2026-03-28 11:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a563d7e-6b23-5f9a-bfd7-01238a25b947, identifier: BA23720
2026-03-28 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 11:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720
2026-03-28 11:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a563d7e-6b23-5f9a-bfd7-01238a25b947 with identifier: BA23720 to the API
2026-03-28 11:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:03:13Z',
 'fuel_type': 'petrol',
 'id': '4a563d7e-6b23-5f9a-bfd7-01238a25b947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA23720',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 124070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-28',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2008}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA23720%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.es] INFO: Saving data for BA23720: {'auction_closing_time': 1774882993.0, 'created_time': 1773128176.877031, 'last_price_update_time': 1774695623.420974}
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA23720') HTTP/1.1" 204 0
2026-03-28 11:00:23 [auto1.es] INFO: Found listing with ID: PL84711
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.es] INFO: Scrape type for PL84711: 1
2026-03-28 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ63273> (referer: https://www.auto1.com/v1/car-details-view/LJ63273/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP60269> (referer: https://www.auto1.com/v1/car-details-view/XP60269/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD68479> (referer: https://www.auto1.com/v1/car-details-view/MD68479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG45325> (referer: https://www.auto1.com/v1/car-details-view/WG45325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:23 [auto1.es] INFO: Found listing with ID: AZ04928
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-28 11:00:23 [auto1.es] INFO: Scrape type for AZ04928: 2
2026-03-28 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-28 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with scrape type 2
2026-03-28 11:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00, identifier: AZ04928
2026-03-28 11:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW31062> (referer: https://www.auto1.com/v1/car-details-view/RW31062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-28 11:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928
2026-03-28 11:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14379ca0-cb74-5f2d-9aca-09ef90b2bc00 with identifier: AZ04928 to the API
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'hybrid',
 'id': '14379ca0-cb74-5f2d-9aca-09ef90b2bc00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ04928',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 46061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2020}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ04928%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.es] INFO: Saving data for AZ04928: {'auction_closing_time': 1774886020.0, 'created_time': 1774001891.140795, 'last_price_update_time': 1774695624.038399}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AZ04928') HTTP/1.1" 204 0
2026-03-28 11:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: ZK54179
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK54179%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.es] INFO: Scrape type for ZK54179: 1
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: JA60709
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.es] INFO: Scrape type for JA60709: 2
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c7167d-998f-5158-8c3e-37400bed320b with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c7167d-998f-5158-8c3e-37400bed320b with scrape type 2
2026-03-28 11:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68c7167d-998f-5158-8c3e-37400bed320b, identifier: JA60709
2026-03-28 11:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-28 11:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709
2026-03-28 11:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68c7167d-998f-5158-8c3e-37400bed320b with identifier: JA60709 to the API
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'diesel',
 'id': '68c7167d-998f-5158-8c3e-37400bed320b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA60709',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-30',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA60709%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.es] INFO: Saving data for JA60709: {'auction_closing_time': 1774883826.0, 'created_time': 1773410524.684106, 'last_price_update_time': 1774695624.649427}
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JA60709') HTTP/1.1" 204 0
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959ca873-f14c-5456-8a6b-12a6945617da with identifier: LJ63273
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ca873-f14c-5456-8a6b-12a6945617da with scrape type 1
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg not downloaded yet
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e71a9d57-b693-5013-b9bf-84c7fe54476c with identifier: XP60269
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e71a9d57-b693-5013-b9bf-84c7fe54476c with scrape type 1
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_288275355b4cc0b12f0c03924dc899fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_288275355b4cc0b12f0c03924dc899fc.jpg not downloaded yet
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061e6b20-34c6-585b-a203-e7dc88c0288b with scrape type 1
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_3b655d69c313456d37f6871d6b4458ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_3b655d69c313456d37f6871d6b4458ed.jpg not downloaded yet
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5c6b348-59c0-5925-b929-7f342b0291d5 with identifier: WG45325
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c6b348-59c0-5925-b929-7f342b0291d5 with scrape type 1
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_de592666df637fcb0e0e69a8536cbbf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_de592666df637fcb0e0e69a8536cbbf3.jpg not downloaded yet
2026-03-28 11:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb416b38-171f-5043-a240-eb36764c8da4 with identifier: RW31062
2026-03-28 11:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb416b38-171f-5043-a240-eb36764c8da4 with scrape type 1
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg not downloaded yet
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: BK75900
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: EF82008
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: TX62344
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: CY52892
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY52892%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [auto1.es] INFO: Scrape type for CY52892: 1
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_83e9cfe0fbb509c8da130b972304533c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_83e9cfe0fbb509c8da130b972304533c.jpg not downloaded yet
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_bb97c889125a83d53882a76daad023a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_bb97c889125a83d53882a76daad023a0.jpg not downloaded yet
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_ae19f6dd36aaf5210be277eb3721af40.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_ae19f6dd36aaf5210be277eb3721af40.jpg not downloaded yet
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg not downloaded yet
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_39f723434060a10b1635b68a043e2150.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_39f723434060a10b1635b68a043e2150.jpg not downloaded yet
2026-03-28 11:00:24 [auto1.es] INFO: Found listing with ID: RW90517
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW90517%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.es] INFO: Scrape type for RW90517: 1
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_9636be85877456fb8af3fe0dcea23032.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_9636be85877456fb8af3fe0dcea23032.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_b79d9c1e95032485349fc1f52eb45241.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_b79d9c1e95032485349fc1f52eb45241.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_25d37acc42f380e5601fec861ff270e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_25d37acc42f380e5601fec861ff270e9.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_96b8786f92965322b01d47444446c846.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_96b8786f92965322b01d47444446c846.jpg not downloaded yet
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: KK87704
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK87704%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.es] INFO: Scrape type for KK87704: 1
2026-03-28 11:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ15822> (referer: https://www.auto1.com/v1/car-details-view/EJ15822/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_558b569c803ad97971797be595f46896.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_558b569c803ad97971797be595f46896.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_1ecb419156d86ead39b85aa6cec85b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_1ecb419156d86ead39b85aa6cec85b21.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_78fda99e6c68125db0919926912cfc73.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_78fda99e6c68125db0919926912cfc73.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg not downloaded yet
2026-03-28 11:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: AF53027
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF53027%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.es] INFO: Scrape type for AF53027: 1
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_8dfe056ba22f11c51fc6870d341851fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_8dfe056ba22f11c51fc6870d341851fb.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_990c41a1651ce00915938d82e9196e61.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_990c41a1651ce00915938d82e9196e61.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_88450a79c233cbc8283a75187b2cacd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_88450a79c233cbc8283a75187b2cacd0.jpg not downloaded yet
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: NX17648
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX17648%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.es] INFO: Scrape type for NX17648: 1
2026-03-28 11:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896509ed-af98-59d5-a992-1153f6ad950f with identifier: EJ15822
2026-03-28 11:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896509ed-af98-59d5-a992-1153f6ad950f with scrape type 1
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_5d810c370ea9ff4089108e099969739c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_5d810c370ea9ff4089108e099969739c.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_b69ab7b19e35509693b01a6a32102f6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_b69ab7b19e35509693b01a6a32102f6c.jpg not downloaded yet
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: RX17538
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: PP42780
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: EK21860
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: EM88527
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: ML70720
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: XA25667
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA25667%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [auto1.es] INFO: Scrape type for XA25667: 1
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_1eeb4006013139ebde157e53df6e2bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_1eeb4006013139ebde157e53df6e2bca.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_075380a9aa40f5573da7a7ad54e12cea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_075380a9aa40f5573da7a7ad54e12cea.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_41df1fb15e85312b5ac404f256df1db8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_41df1fb15e85312b5ac404f256df1db8.jpg not downloaded yet
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: LH42756
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: YS26400
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: DL67174
2026-03-28 11:00:25 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg not downloaded yet
2026-03-28 11:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW93745> (referer: https://www.auto1.com/v1/car-details-view/PW93745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_55c950feb062fdac19e98521965067a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_55c950feb062fdac19e98521965067a9.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_9adba6c0b6782eab20ca93738b51c587.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_9adba6c0b6782eab20ca93738b51c587.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_59746674f55042897bf272d659ba8c46.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_59746674f55042897bf272d659ba8c46.jpg not downloaded yet
2026-03-28 11:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_2882366193f6ecf6a20c980331f267c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_2882366193f6ecf6a20c980331f267c1.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_a237bde7e7f1a181f452cecdf082da18.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_a237bde7e7f1a181f452cecdf082da18.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_11d5485072d0196a455eb97930f4aae8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_11d5485072d0196a455eb97930f4aae8.jpg not downloaded yet
2026-03-28 11:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX05735> (referer: https://www.auto1.com/v1/car-details-view/LX05735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX30017> (referer: https://www.auto1.com/v1/car-details-view/HX30017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_490cc8d7925f707a128eaaad76ba8660.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_490cc8d7925f707a128eaaad76ba8660.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_c14b950fb527f715186f2b3c03cd09c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_c14b950fb527f715186f2b3c03cd09c2.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_cab8178208d203b1e90d1b44dc43c727.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_cab8178208d203b1e90d1b44dc43c727.jpg not downloaded yet
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_0021c49bd5548428e6d890c5676678fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_0021c49bd5548428e6d890c5676678fc.jpg not downloaded yet
2026-03-28 11:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with identifier: PW93745
2026-03-28 11:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with scrape type 1
2026-03-28 11:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_fc217510a939b95bc1de07fbaa0929db.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_fc217510a939b95bc1de07fbaa0929db.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_7c7cfc05802c574f531109d93ae02056.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c7cfc05802c574f531109d93ae02056.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY19830> (referer: https://www.auto1.com/v1/car-details-view/SY19830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg not downloaded yet
2026-03-28 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with identifier: LX05735
2026-03-28 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with scrape type 1
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg not downloaded yet
2026-03-28 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2d7583-ecd9-56c2-ad3c-825b81a0b739 with identifier: HX30017
2026-03-28 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2d7583-ecd9-56c2-ad3c-825b81a0b739 with scrape type 1
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_e5efd775be543740d6bdcf083da33d9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_e5efd775be543740d6bdcf083da33d9b.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_c8d451afc043112c5247ed316a3f98bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_c8d451afc043112c5247ed316a3f98bc.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_cd274471995252795e7f16f8d32df617.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_cd274471995252795e7f16f8d32df617.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_385e9bc733e58c70f29acae77d740d33.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_385e9bc733e58c70f29acae77d740d33.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_444e0e7ef5a0646b9c2e358a201db797.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_444e0e7ef5a0646b9c2e358a201db797.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg not downloaded yet
2026-03-28 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9741df9d-ac05-5d57-b136-2052d064d27d with identifier: SY19830
2026-03-28 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9741df9d-ac05-5d57-b136-2052d064d27d with scrape type 1
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_44d9a91e44df0ce0a19285c3fab55918.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_44d9a91e44df0ce0a19285c3fab55918.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_96b8786f92965322b01d47444446c846.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_1c61a2ac231521194ac3b119715b9c32.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_1c61a2ac231521194ac3b119715b9c32.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_6c343936eb7105a04b40794828a02fd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_6c343936eb7105a04b40794828a02fd0.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_e7a80d8968adee54e0decb06b8919928.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_e7a80d8968adee54e0decb06b8919928.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_41df1fb15e85312b5ac404f256df1db8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_528a2262952f220ce342ddb8f8606dcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_528a2262952f220ce342ddb8f8606dcd.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_d303a90f63f34b2a8242d58283d51829.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d303a90f63f34b2a8242d58283d51829.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_2f5dda6c9acd56fc922c53583539b761.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_2f5dda6c9acd56fc922c53583539b761.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_0426367151b7bf366f9283c3f7f41721.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_0426367151b7bf366f9283c3f7f41721.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG51857> (referer: https://www.auto1.com/v1/car-details-view/EG51857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_76b4009eef520caf9d1044ba59d279cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_76b4009eef520caf9d1044ba59d279cb.jpg not downloaded yet
2026-03-28 11:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273d79d0>
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_96b8786f92965322b01d47444446c846.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_96b8786f92965322b01d47444446c846.jpg saved to cache
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_44d9a91e44df0ce0a19285c3fab55918.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_a237bde7e7f1a181f452cecdf082da18.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_19362ccdecdb93155f16207aa6be5cc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_19362ccdecdb93155f16207aa6be5cc3.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c7cfc05802c574f531109d93ae02056.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_6c343936eb7105a04b40794828a02fd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271d4fd0>
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_41df1fb15e85312b5ac404f256df1db8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_41df1fb15e85312b5ac404f256df1db8.jpg saved to cache
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb18b0d-d043-5f64-a2f1-e940d7115442 with identifier: EG51857
2026-03-28 11:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb18b0d-d043-5f64-a2f1-e940d7115442 with scrape type 1
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_0be9f1eb22a98234075dc04a4904e255.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_0be9f1eb22a98234075dc04a4904e255.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg not downloaded yet
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_d97d4550bdd73738b2caa1515af8e43c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d97d4550bdd73738b2caa1515af8e43c.jpg not downloaded yet
2026-03-28 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS53334> (referer: https://www.auto1.com/v1/car-details-view/TS53334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272efad0>
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_44d9a91e44df0ce0a19285c3fab55918.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_44d9a91e44df0ce0a19285c3fab55918.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272e7bd0>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_a237bde7e7f1a181f452cecdf082da18.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_a237bde7e7f1a181f452cecdf082da18.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg not downloaded yet
2026-03-28 11:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_76b4009eef520caf9d1044ba59d279cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_767fbdfc8c91f0dafd90d0353553744c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_767fbdfc8c91f0dafd90d0353553744c.jpg not downloaded yet
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273426d0>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_7c7cfc05802c574f531109d93ae02056.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c7cfc05802c574f531109d93ae02056.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727167910>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727375d50>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_6c343936eb7105a04b40794828a02fd0.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_6c343936eb7105a04b40794828a02fd0.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg not downloaded yet
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE70928> (referer: https://www.auto1.com/v1/car-details-view/KE70928/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_528a2262952f220ce342ddb8f8606dcd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_0426367151b7bf366f9283c3f7f41721.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg not downloaded yet
2026-03-28 11:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL84711/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_2f5dda6c9acd56fc922c53583539b761.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_8fed289f469800dd15cb2b743e275798.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8fed289f469800dd15cb2b743e275798.jpg not downloaded yet
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR94321> (referer: https://www.auto1.com/v1/car-details-view/FR94321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP47288> (referer: https://www.auto1.com/v1/car-details-view/AP47288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3724f40-5649-51e5-8f69-68386ee34def with identifier: TS53334
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3724f40-5649-51e5-8f69-68386ee34def with scrape type 1
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_ea6f967d459eb84e55df38649bbb6a65.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_ea6f967d459eb84e55df38649bbb6a65.jpg not downloaded yet
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727279590>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_76b4009eef520caf9d1044ba59d279cb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_76b4009eef520caf9d1044ba59d279cb.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_35191f8978546e907f647df3eead7c41.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_35191f8978546e907f647df3eead7c41.jpg not downloaded yet
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_e34c791e69cffc913e843dfccbf19bd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_e34c791e69cffc913e843dfccbf19bd2.jpg not downloaded yet
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_0bed44fbd3698a96d353833deae9c5eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_0bed44fbd3698a96d353833deae9c5eb.jpg not downloaded yet
2026-03-28 11:00:27 [auto1.es] INFO: Channel: 24h | Page: 3 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b36783f2-0e21-5f0b-9032-497e29bc39d0 with identifier: KE70928
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36783f2-0e21-5f0b-9032-497e29bc39d0 with scrape type 1
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg not downloaded yet
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271efdd0>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_528a2262952f220ce342ddb8f8606dcd.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_528a2262952f220ce342ddb8f8606dcd.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726751250>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_0426367151b7bf366f9283c3f7f41721.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_0426367151b7bf366f9283c3f7f41721.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72674b510>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg not downloaded yet
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg not downloaded yet
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d303a90f63f34b2a8242d58283d51829.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d97d4550bdd73738b2caa1515af8e43c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: VT22035
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: BM94316
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: NP14618
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: MS21138
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: EG18417
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: MH61134
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: SJ29812
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ29812%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [auto1.es] INFO: Scrape type for SJ29812: 1
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg not downloaded yet
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_0be9f1eb22a98234075dc04a4904e255.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_767fbdfc8c91f0dafd90d0353553744c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg not downloaded yet
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_f889f87c208c9c2c45032980f55207bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f889f87c208c9c2c45032980f55207bd.jpg not downloaded yet
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72676be90>
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_2f5dda6c9acd56fc922c53583539b761.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_2f5dda6c9acd56fc922c53583539b761.jpg saved to cache
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with identifier: FR94321
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with scrape type 1
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_a7668b9c040a0b8058d5144f366b4382.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a7668b9c040a0b8058d5144f366b4382.jpg not downloaded yet
2026-03-28 11:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6454f313-04ef-55b3-9af3-1457e8f38e1d with identifier: AP47288
2026-03-28 11:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6454f313-04ef-55b3-9af3-1457e8f38e1d with scrape type 1
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_38dece5c85384abbf54b6b94a86be646.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_38dece5c85384abbf54b6b94a86be646.jpg not downloaded yet
2026-03-28 11:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: YR47021
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: HD15587
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: RV46161
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: BE52894
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: VG10975
2026-03-28 11:00:27 [auto1.es] INFO: Found listing with ID: VC46387
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC46387%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [auto1.es] INFO: Scrape type for VC46387: 1
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_4a286c64317a800439f075557ac8abfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_4a286c64317a800439f075557ac8abfd.jpg not downloaded yet
2026-03-28 11:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ67875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_8ce4d2ede319c99228416d0d9479b216.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8ce4d2ede319c99228416d0d9479b216.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_6611786b4baf0e57598ed286737f3ab4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6611786b4baf0e57598ed286737f3ab4.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_25add4b207d1cd74a3b5ae97240db287.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_25add4b207d1cd74a3b5ae97240db287.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_ec3f6f215325f492c67270a2e7f8824d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_ec3f6f215325f492c67270a2e7f8824d.jpg not downloaded yet
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_19362ccdecdb93155f16207aa6be5cc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: PT83214
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT83214%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.es] INFO: Scrape type for PT83214: 1
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg not downloaded yet
2026-03-28 11:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270d3450>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f6ed0>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_d303a90f63f34b2a8242d58283d51829.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d303a90f63f34b2a8242d58283d51829.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266ef990>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_d97d4550bdd73738b2caa1515af8e43c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d97d4550bdd73738b2caa1515af8e43c.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265110d0>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_0be9f1eb22a98234075dc04a4904e255.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_0be9f1eb22a98234075dc04a4904e255.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726510910>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_767fbdfc8c91f0dafd90d0353553744c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_767fbdfc8c91f0dafd90d0353553744c.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f4050>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_0bed44fbd3698a96d353833deae9c5eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_05c66bc6766b42e5c427eb88375c6212.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_05c66bc6766b42e5c427eb88375c6212.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_52e0cd65a0c823406ab56596d267a3d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_52e0cd65a0c823406ab56596d267a3d6.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_b38d6449cb4613aa14eba770eeb8992b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b38d6449cb4613aa14eba770eeb8992b.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_077abad4212a6e110ce851a5dac50213.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_077abad4212a6e110ce851a5dac50213.jpg not downloaded yet
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_e7a80d8968adee54e0decb06b8919928.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: JM22028
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM22028%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.es] INFO: Scrape type for JM22028: 1
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg not downloaded yet
2026-03-28 11:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_f581eef95e869053fdef3b9eb9c724f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f581eef95e869053fdef3b9eb9c724f3.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_b673c5308d818d8e5a5461fc007028b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b673c5308d818d8e5a5461fc007028b7.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_090e6ea07426e162cc39c6b62419869f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_090e6ea07426e162cc39c6b62419869f.jpg not downloaded yet
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727017890>
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_19362ccdecdb93155f16207aa6be5cc3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_19362ccdecdb93155f16207aa6be5cc3.jpg saved to cache
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: BE06656
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: BB43424
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: PP51748
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP51748%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.es] INFO: Scrape type for PP51748: 1
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_8972ab9da2789048ece29a6760488d3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_8972ab9da2789048ece29a6760488d3c.jpg not downloaded yet
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA33750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_e34c791e69cffc913e843dfccbf19bd2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_15818813389322806b4432c83c430f17.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_15818813389322806b4432c83c430f17.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_12a4385b00cbc19b11e471d48298f75a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_12a4385b00cbc19b11e471d48298f75a.jpg not downloaded yet
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg not downloaded yet
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_4a286c64317a800439f075557ac8abfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_25add4b207d1cd74a3b5ae97240db287.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: UR52438
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: PS14149
2026-03-28 11:00:28 [auto1.es] INFO: Found listing with ID: KW41207
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-28 11:00:28 [auto1.es] INFO: Scrape type for KW41207: 2
2026-03-28 11:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-28 11:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-03-28 11:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09f6640-f68b-5e2e-86fe-53c0624e6dfc with scrape type 2
2026-03-28 11:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a09f6640-f68b-5e2e-86fe-53c0624e6dfc, identifier: KW41207
2026-03-28 11:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726742810>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727201d90>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_0bed44fbd3698a96d353833deae9c5eb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_0bed44fbd3698a96d353833deae9c5eb.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f6a50>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726741210>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_e7a80d8968adee54e0decb06b8919928.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_e7a80d8968adee54e0decb06b8919928.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727477050>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726740410>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266ed710>
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg saved to cache
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_ec3f6f215325f492c67270a2e7f8824d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_841747ddbd70871aafeb81107417515d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_841747ddbd70871aafeb81107417515d.jpg not downloaded yet
2026-03-28 11:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-28 11:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207
2026-03-28 11:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a09f6640-f68b-5e2e-86fe-53c0624e6dfc with identifier: KW41207 to the API
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'diesel',
 'id': 'a09f6640-f68b-5e2e-86fe-53c0624e6dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW41207',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 112407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-02',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference Copa',
 'transmission': 'manual',
 'trim': 'Reference Copa',
 'year': 2011}
2026-03-28 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW41207%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.es] INFO: Saving data for KW41207: {'auction_closing_time': 1774884421.0, 'created_time': 1774015494.131213, 'last_price_update_time': 1774695630.004583}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KW41207') HTTP/1.1" 204 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_76d55d08eb5ab9cdbe787e155e290012.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_76d55d08eb5ab9cdbe787e155e290012.jpg not downloaded yet
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_6cbc98961197373810b32779f2c5cd2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cbc98961197373810b32779f2c5cd2a.jpg not downloaded yet
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [auto1.es] INFO: Found listing with ID: DZ14313
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.es] INFO: Scrape type for DZ14313: 2
2026-03-28 11:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-28 11:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with scrape type 2
2026-03-28 11:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7, identifier: DZ14313
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b38d6449cb4613aa14eba770eeb8992b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_077abad4212a6e110ce851a5dac50213.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg not downloaded yet
2026-03-28 11:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-28 11:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313
2026-03-28 11:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af095160-2b8c-51a6-92d0-ac9e8b1e6fa7 with identifier: DZ14313 to the API
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': 'af095160-2b8c-51a6-92d0-ac9e8b1e6fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ14313',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 141564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ14313%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.es] INFO: Saving data for DZ14313: {'auction_closing_time': 1774885097.0, 'created_time': 1774015650.665335, 'last_price_update_time': 1774695630.697576}
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DZ14313') HTTP/1.1" 204 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_f6c8dd88122267a4035aac3431f08e37.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_f6c8dd88122267a4035aac3431f08e37.jpg not downloaded yet
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_6cf7063deec840b23b040538428019b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cf7063deec840b23b040538428019b7.jpg not downloaded yet
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX72954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72674b790>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg saved to cache
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727387bd0>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg saved to cache
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727341190>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_e34c791e69cffc913e843dfccbf19bd2.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_e34c791e69cffc913e843dfccbf19bd2.jpg saved to cache
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a9490>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_4a286c64317a800439f075557ac8abfd.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_4a286c64317a800439f075557ac8abfd.jpg saved to cache
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727340890>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_25add4b207d1cd74a3b5ae97240db287.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_25add4b207d1cd74a3b5ae97240db287.jpg saved to cache
2026-03-28 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b673c5308d818d8e5a5461fc007028b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_52e0cd65a0c823406ab56596d267a3d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_090e6ea07426e162cc39c6b62419869f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:30 [auto1.es] INFO: Found listing with ID: GB85500
2026-03-28 11:00:30 [auto1.es] INFO: Found listing with ID: MM10114
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM10114%27 HTTP/1.1" 200 None
2026-03-28 11:00:30 [auto1.es] INFO: Scrape type for MM10114: 1
2026-03-28 11:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72738bf50>
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_ec3f6f215325f492c67270a2e7f8824d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_ec3f6f215325f492c67270a2e7f8824d.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f581eef95e869053fdef3b9eb9c724f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_d9ff57fbb9318fdd48e17568a178af33.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_d9ff57fbb9318fdd48e17568a178af33.jpg not downloaded yet
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_146138bc721f2e518723c54cf5794ea7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_146138bc721f2e518723c54cf5794ea7.jpg not downloaded yet
2026-03-28 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727243b90>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_8972ab9da2789048ece29a6760488d3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: HB49696
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: BD69274
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD69274%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for BD69274: 1
2026-03-28 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726742910>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_b38d6449cb4613aa14eba770eeb8992b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b38d6449cb4613aa14eba770eeb8992b.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703f490>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_077abad4212a6e110ce851a5dac50213.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_077abad4212a6e110ce851a5dac50213.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:31 [auto1.es] INFO: Channel: 24h | Page: 4 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_12a4385b00cbc19b11e471d48298f75a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg not downloaded yet
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_5032877013f92eda609b4851d5c70fd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_5032877013f92eda609b4851d5c70fd5.jpg not downloaded yet
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72651e990>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_b673c5308d818d8e5a5461fc007028b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b673c5308d818d8e5a5461fc007028b7.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72661ce50>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_52e0cd65a0c823406ab56596d267a3d6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_52e0cd65a0c823406ab56596d267a3d6.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266e5490>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_090e6ea07426e162cc39c6b62419869f.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_090e6ea07426e162cc39c6b62419869f.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_76d55d08eb5ab9cdbe787e155e290012.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: ES13897
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES13897%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for ES13897: 1
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: KK57262
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK57262%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for KK57262: 1
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cbc98961197373810b32779f2c5cd2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg not downloaded yet
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg not downloaded yet
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT83214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72661d850>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_f581eef95e869053fdef3b9eb9c724f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f581eef95e869053fdef3b9eb9c724f3.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726758610>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_8972ab9da2789048ece29a6760488d3c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_8972ab9da2789048ece29a6760488d3c.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e7e10>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_841747ddbd70871aafeb81107417515d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_05c66bc6766b42e5c427eb88375c6212.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: PD50482
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD50482%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for PD50482: 1
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: PL51206
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: GZ44796
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: EU70316
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU70316%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for EU70316: 1
2026-03-28 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f1a90>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_12a4385b00cbc19b11e471d48298f75a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_12a4385b00cbc19b11e471d48298f75a.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_15818813389322806b4432c83c430f17.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cf7063deec840b23b040538428019b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_146138bc721f2e518723c54cf5794ea7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: FP09547
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: KU62533
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: JZ72773
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ72773%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for JZ72773: 1
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: PN86377
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: MF61460
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF61460%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for MF61460: 1
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e9410>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_76d55d08eb5ab9cdbe787e155e290012.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_76d55d08eb5ab9cdbe787e155e290012.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267796d0>
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_6cbc98961197373810b32779f2c5cd2a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cbc98961197373810b32779f2c5cd2a.jpg saved to cache
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: SX89883
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: KP23641
2026-03-28 11:00:31 [auto1.es] INFO: Found listing with ID: FN14601
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-28 11:00:31 [auto1.es] INFO: Scrape type for FN14601: 2
2026-03-28 11:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-28 11:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-03-28 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec82a39-ff08-50d5-9d41-f2c30f9528c2 with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eec82a39-ff08-50d5-9d41-f2c30f9528c2, identifier: FN14601
2026-03-28 11:00:32 [auto1.es] INFO: Found listing with ID: JS10706
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS10706%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.es] INFO: Scrape type for JS10706: 1
2026-03-28 11:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-28 11:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601
2026-03-28 11:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eec82a39-ff08-50d5-9d41-f2c30f9528c2 with identifier: FN14601 to the API
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:56Z',
 'fuel_type': 'diesel',
 'id': 'eec82a39-ff08-50d5-9d41-f2c30f9528c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN14601',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 17423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-15',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 30 mittellang FWD',
 'transmission': 'manual',
 'trim': 'Kasten 30 mittellang FWD',
 'year': 2025}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN14601%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.es] INFO: Saving data for FN14601: {'auction_closing_time': 1774884416.0, 'created_time': 1774015690.034891, 'last_price_update_time': 1774695632.543284}
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN14601') HTTP/1.1" 204 0
2026-03-28 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP51748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d994850>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_841747ddbd70871aafeb81107417515d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_841747ddbd70871aafeb81107417515d.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727240f90>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d305350>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_05c66bc6766b42e5c427eb88375c6212.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_05c66bc6766b42e5c427eb88375c6212.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727126d90>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_15818813389322806b4432c83c430f17.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_15818813389322806b4432c83c430f17.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d5fac10>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_6cf7063deec840b23b040538428019b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cf7063deec840b23b040538428019b7.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271e5ed0>
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_146138bc721f2e518723c54cf5794ea7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_146138bc721f2e518723c54cf5794ea7.jpg saved to cache
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:32 [auto1.es] INFO: Found listing with ID: ZT45272
2026-03-28 11:00:32 [auto1.es] INFO: Found listing with ID: EW17140
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW17140%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.es] INFO: Scrape type for EW17140: 1
2026-03-28 11:00:32 [auto1.es] INFO: Found listing with ID: UG73300
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-28 11:00:32 [auto1.es] INFO: Scrape type for UG73300: 2
2026-03-28 11:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-28 11:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with scrape type 2
2026-03-28 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 460b4d1c-b5da-54b0-9911-7f10bf902ac6, identifier: UG73300
2026-03-28 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_5032877013f92eda609b4851d5c70fd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-28 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300
2026-03-28 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 460b4d1c-b5da-54b0-9911-7f10bf902ac6 with identifier: UG73300 to the API
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:03:02Z',
 'fuel_type': 'diesel',
 'id': '460b4d1c-b5da-54b0-9911-7f10bf902ac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG73300',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 109464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG73300%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Saving data for UG73300: {'auction_closing_time': 1774882982.0, 'created_time': 1772753272.57651, 'last_price_update_time': 1774695633.435461}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG73300') HTTP/1.1" 204 0
2026-03-28 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ67875> (referer: https://www.auto1.com/v1/car-details-view/NJ67875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: GP84876
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: FF19626
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF19626%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Scrape type for FF19626: 1
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: CE73826
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: DW64016
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Scrape type for DW64016: 2
2026-03-28 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-28 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc22b351-d8ec-5f29-92d4-94887b58b5f9 with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc22b351-d8ec-5f29-92d4-94887b58b5f9 with scrape type 2
2026-03-28 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc22b351-d8ec-5f29-92d4-94887b58b5f9, identifier: DW64016
2026-03-28 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA33750> (referer: https://www.auto1.com/v1/car-details-view/VA33750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-28 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016
2026-03-28 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc22b351-d8ec-5f29-92d4-94887b58b5f9 with identifier: DW64016 to the API
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:25:19Z',
 'fuel_type': 'petrol',
 'id': 'dc22b351-d8ec-5f29-92d4-94887b58b5f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW64016',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 229901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW64016%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Saving data for DW64016: {'auction_closing_time': 1774884319.0, 'created_time': 1773410545.760771, 'last_price_update_time': 1774695633.903286}
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW64016') HTTP/1.1" 204 0
2026-03-28 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: GG14536
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: XF41535
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF41535%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Scrape type for XF41535: 1
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: XB82673
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: NM22189
2026-03-28 11:00:33 [auto1.es] INFO: Found listing with ID: BA61536
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA61536%27 HTTP/1.1" 200 None
2026-03-28 11:00:33 [auto1.es] INFO: Scrape type for BA61536: 1
2026-03-28 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM10114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271255d0>
2026-03-28 11:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg saved to cache
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266e7290>
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_5032877013f92eda609b4851d5c70fd5.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_5032877013f92eda609b4851d5c70fd5.jpg saved to cache
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270b8590>
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg saved to cache
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: UP09375
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP09375%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for UP09375: 1
2026-03-28 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecedec74-6c22-5b1c-ace7-9d406c2c48ca with identifier: NJ67875
2026-03-28 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca with scrape type 1
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_82f96121a0f35b33b78b412021d53a5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_82f96121a0f35b33b78b412021d53a5b.jpg not downloaded yet
2026-03-28 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc700c12-d0e3-5211-9202-9654f2c06c5e with identifier: VA33750
2026-03-28 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc700c12-d0e3-5211-9202-9654f2c06c5e with scrape type 1
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg not downloaded yet
2026-03-28 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC46387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: GE22021
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE22021%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for GE22021: 1
2026-03-28 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg not downloaded yet
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_7a848e7a814d110d9723ae774a26d7ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7a848e7a814d110d9723ae774a26d7ce.jpg not downloaded yet
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: FA09072
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA09072%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for FA09072: 1
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_a8255cc452869be671bf80cbaac5d660.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_a8255cc452869be671bf80cbaac5d660.jpg not downloaded yet
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_94827a16a589db1ed451d4c9db84b754.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_94827a16a589db1ed451d4c9db84b754.jpg not downloaded yet
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: ZH42049
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH42049%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for ZH42049: 1
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg not downloaded yet
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_c2215bd76ace6dc52307d476dc86392e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_c2215bd76ace6dc52307d476dc86392e.jpg not downloaded yet
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: LB38939
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB38939%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for LB38939: 1
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_b50a156ca9e06df4306ffdccd5670632.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_b50a156ca9e06df4306ffdccd5670632.jpg not downloaded yet
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg not downloaded yet
2026-03-28 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: RV29319
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for RV29319: 1
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_20f0fad99a521595975a6261bbe7b858.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_20f0fad99a521595975a6261bbe7b858.jpg not downloaded yet
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg not downloaded yet
2026-03-28 11:00:34 [auto1.es] INFO: Found listing with ID: US62634
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [auto1.es] INFO: Scrape type for US62634: 2
2026-03-28 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-28 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293340dc-a86b-5def-944a-801bccd1ff63 with scrape type 2
2026-03-28 11:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 293340dc-a86b-5def-944a-801bccd1ff63, identifier: US62634
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg not downloaded yet
2026-03-28 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634
2026-03-28 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 293340dc-a86b-5def-944a-801bccd1ff63 with identifier: US62634 to the API
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'gas',
 'id': '293340dc-a86b-5def-944a-801bccd1ff63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US62634',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 33466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62634%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.es] INFO: Saving data for US62634: {'auction_closing_time': 1774885963.0, 'created_time': 1772753596.812938, 'last_price_update_time': 1774695635.386724}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US62634') HTTP/1.1" 204 0
2026-03-28 11:00:35 [auto1.es] INFO: Found listing with ID: XN12672
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.es] INFO: Scrape type for XN12672: 2
2026-03-28 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-28 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6cc0662-1e2a-51e2-abe4-c188536caecb with scrape type 2
2026-03-28 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6cc0662-1e2a-51e2-abe4-c188536caecb, identifier: XN12672
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg not downloaded yet
2026-03-28 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-28 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672
2026-03-28 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6cc0662-1e2a-51e2-abe4-c188536caecb with identifier: XN12672 to the API
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:50:49Z',
 'fuel_type': 'petrol',
 'id': 'f6cc0662-1e2a-51e2-abe4-c188536caecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN12672',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 61150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN12672%27 HTTP/1.1" 200 None
2026-03-28 11:00:35 [auto1.es] INFO: Saving data for XN12672: {'auction_closing_time': 1774885849.0, 'created_time': 1774015598.000568, 'last_price_update_time': 1774695635.981937}
2026-03-28 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XN12672') HTTP/1.1" 204 0
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU70316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267914d0>
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg saved to cache
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YH49695
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RW91373
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RP67068
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP67068%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for RP67068: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: LG74328
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RF85744
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF85744%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for RF85744: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YX32704
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX32704%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for YX32704: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ZG63896
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: XN94474
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN94474%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for XN94474: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: VU26922
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: AG57096
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: CM29770
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM29770%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for CM29770: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: PU80612
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RX82713
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82713%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for RX82713: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: AE71783
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE71783%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for AE71783: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: GH02704
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: GR51630
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR51630%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for GR51630: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: CM09391
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM09391%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for CM09391: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: DU59373
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU59373%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for DU59373: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ZH62909
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg not downloaded yet
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX72954> (referer: https://www.auto1.com/v1/car-details-view/DX72954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES13897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK57262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_4b914be6772fcca54140a340768e76f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4b914be6772fcca54140a340768e76f8.jpg not downloaded yet
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726688b10>
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg saved to cache
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec334d0c-0390-516a-99fe-648aed55873d with identifier: DX72954
2026-03-28 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec334d0c-0390-516a-99fe-648aed55873d with scrape type 1
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9e8b6f648f0473fd156bcf350b326792.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9e8b6f648f0473fd156bcf350b326792.jpg not downloaded yet
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_b50a156ca9e06df4306ffdccd5670632.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_72c88536a1ce534f636a13242263f169.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_72c88536a1ce534f636a13242263f169.jpg not downloaded yet
2026-03-28 11:00:36 [auto1.es] INFO: Channel: 24h | Page: 5 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_e1002be26348b299da3bc6f8a4ef06be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_e1002be26348b299da3bc6f8a4ef06be.jpg not downloaded yet
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: HZ84685
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84685%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for HZ84685: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: GC12558
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: KD17519
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD17519%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for KD17519: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: UZ29384
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: KA03965
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA03965%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for KA03965: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: WN30367
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN30367%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for WN30367: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: FC18044
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC18044%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for FC18044: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: EE40480
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE40480%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for EE40480: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ZU46399
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU46399%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for ZU46399: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: KY80374
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ZB60783
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YZ74298
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YK64988
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YJ21148
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: YC05678
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC05678%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for YC05678: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: XN99288
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: XJ10709
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ10709%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for XJ10709: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: XA46112
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: WZ01367
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: WY32728
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: WG12182
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12182%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for WG12182: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: WB05226
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: UG63824
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG63824%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for UG63824: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: VV17373
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV17373%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for VV17373: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: VN92825
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: VJ45850
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ45850%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for VJ45850: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: VE30170
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE30170%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for VE30170: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ZF31827
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: US42967
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: UB14006
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB14006%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for UB14006: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: TG79405
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: TE76337
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: TA28107
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA28107%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for TA28107: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: SZ88467
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ88467%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for SZ88467: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: ST22726
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: SP63286
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RY07165
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: RW95196
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW95196%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [auto1.es] INFO: Scrape type for RW95196: 0
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: NV56765
2026-03-28 11:00:36 [auto1.es] INFO: Found listing with ID: NN81936
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9d14684d9efe630f6e07309bcf89a872.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9d14684d9efe630f6e07309bcf89a872.jpg not downloaded yet
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_20f0fad99a521595975a6261bbe7b858.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_892905e6333b478882abe7fb389e7b0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_892905e6333b478882abe7fb389e7b0d.jpg not downloaded yet
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD50482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272e5310>
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_b50a156ca9e06df4306ffdccd5670632.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_b50a156ca9e06df4306ffdccd5670632.jpg saved to cache
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_74b3452f83747798df62fea1b292224b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_74b3452f83747798df62fea1b292224b.jpg not downloaded yet
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72726b450>
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg saved to cache
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg not downloaded yet
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_394cf30e11a2c0cd380c29ea6d648790.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_394cf30e11a2c0cd380c29ea6d648790.jpg not downloaded yet
2026-03-28 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_72c88536a1ce534f636a13242263f169.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg not downloaded yet
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726725290>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b1790>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d6041d0>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_20f0fad99a521595975a6261bbe7b858.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_20f0fad99a521595975a6261bbe7b858.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg not downloaded yet
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_e1002be26348b299da3bc6f8a4ef06be.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9d14684d9efe630f6e07309bcf89a872.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d600290>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_72c88536a1ce534f636a13242263f169.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_72c88536a1ce534f636a13242263f169.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727012650>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_e1002be26348b299da3bc6f8a4ef06be.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_e1002be26348b299da3bc6f8a4ef06be.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727471a10>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9d14684d9efe630f6e07309bcf89a872.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9d14684d9efe630f6e07309bcf89a872.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_394cf30e11a2c0cd380c29ea6d648790.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW17140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ72773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72724fa90>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_394cf30e11a2c0cd380c29ea6d648790.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_394cf30e11a2c0cd380c29ea6d648790.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS10706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270d5150>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9e8b6f648f0473fd156bcf350b326792.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270de150>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT83214> (referer: https://www.auto1.com/v1/car-details-view/PT83214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF61460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_74b3452f83747798df62fea1b292224b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_892905e6333b478882abe7fb389e7b0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270135d0>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_9e8b6f648f0473fd156bcf350b326792.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9e8b6f648f0473fd156bcf350b326792.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4b914be6772fcca54140a340768e76f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc50a4f0-f7a3-5845-b5af-63f5eda26102 with identifier: PT83214
2026-03-28 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc50a4f0-f7a3-5845-b5af-63f5eda26102 with scrape type 1
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_db96413b631396f4198dd5039be81b49.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_db96413b631396f4198dd5039be81b49.jpg not downloaded yet
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg not downloaded yet
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_c2215bd76ace6dc52307d476dc86392e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_2fdfd52f460b03206a6238b29ef151ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_2fdfd52f460b03206a6238b29ef151ea.jpg not downloaded yet
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg not downloaded yet
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF19626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727218290>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267eaf90>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_74b3452f83747798df62fea1b292224b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_74b3452f83747798df62fea1b292224b.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b6410>
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fab%252F22abfc061f49463eb2d9ca1ec70d2d4c%252Fpa%252FDX72954_892905e6333b478882abe7fb389e7b0d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_892905e6333b478882abe7fb389e7b0d.jpg saved to cache
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec334d0c-0390-516a-99fe-648aed55873d
2026-03-28 11:00:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec334d0c-0390-516a-99fe-648aed55873d, skipping ID generation
2026-03-28 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec334d0c-0390-516a-99fe-648aed55873d with scrape type 1
2026-03-28 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec334d0c-0390-516a-99fe-648aed55873d sending to next pipeline
2026-03-28 11:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec334d0c-0390-516a-99fe-648aed55873d, identifier: DX72954
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_1574116328ab029d11448e1759b68d3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_1574116328ab029d11448e1759b68d3e.jpg not downloaded yet
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec334d0c-0390-516a-99fe-648aed55873d with identifier: DX72954
2026-03-28 11:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec334d0c-0390-516a-99fe-648aed55873d with identifier: DX72954
2026-03-28 11:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec334d0c-0390-516a-99fe-648aed55873d with identifier: DX72954 to the API
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_892905e6333b478882abe7fb389e7b0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'diesel',
 'id': 'ec334d0c-0390-516a-99fe-648aed55873d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX72954',
 'listing': 'auction',
 'location': 'ES, Rivas-Vaciamadrid, Madrid',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 108187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9e8b6f648f0473fd156bcf350b326792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_72c88536a1ce534f636a13242263f169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_e1002be26348b299da3bc6f8a4ef06be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9d14684d9efe630f6e07309bcf89a872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_892905e6333b478882abe7fb389e7b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_74b3452f83747798df62fea1b292224b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_5e5a2a1f845b921995b5e03d776fa1fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_394cf30e11a2c0cd380c29ea6d648790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_7becd15e21afc61bf9bf39f26e7e91d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec334d0c-0390-516a-99fe-648aed55873d/ec334d0c-0390-516a-99fe-648aed55873d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/ab/22abfc061f49463eb2d9ca1ec70d2d4c/pa/DX72954_9c02f61dcd2c1aa08572b7c34e19a2a7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d Mild-Hybrid Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2021}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX72954%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.es] INFO: Saving data for DX72954: {'created_time': 1774695638.722513, 'last_price_update_time': 1774695638.722525, 'auction_closing_time': 1774885729.0}
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX72954') HTTP/1.1" 204 0
2026-03-28 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_f42a3141f490485bc21f4c2674e42760.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_f42a3141f490485bc21f4c2674e42760.jpg not downloaded yet
2026-03-28 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP51748> (referer: https://www.auto1.com/v1/car-details-view/PP51748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV29319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES13897> (referer: https://www.auto1.com/v1/car-details-view/ES13897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UA24744> (referer: https://www.auto1.com/v1/car-details-view/UA24744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727202f50>
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_4b914be6772fcca54140a340768e76f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4b914be6772fcca54140a340768e76f8.jpg saved to cache
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272e71d0>
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg saved to cache
2026-03-28 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e8050>
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_c2215bd76ace6dc52307d476dc86392e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_c2215bd76ace6dc52307d476dc86392e.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_563f3f1d62ded6fa4682f601560505c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_563f3f1d62ded6fa4682f601560505c1.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_055fda591ccd95ac62cd17b994582538.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_055fda591ccd95ac62cd17b994582538.jpg not downloaded yet
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727014550>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54471b7-d2fb-5a6e-aabb-9d806a348dbc with identifier: PP51748
2026-03-28 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc with scrape type 1
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_e3748665e64e34c2a68814c35f8af072.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_e3748665e64e34c2a68814c35f8af072.jpg not downloaded yet
2026-03-28 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4101ea8f-bade-5805-b5cc-e3cb62a583ed with identifier: ES13897
2026-03-28 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed with scrape type 1
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg not downloaded yet
2026-03-28 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de5ab3c7-9045-57ad-abc0-758ab59faf1c with identifier: UA24744
2026-03-28 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5ab3c7-9045-57ad-abc0-758ab59faf1c with scrape type 1
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_9d10e4b97cea153107ee4e9a4666e543.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_9d10e4b97cea153107ee4e9a4666e543.jpg not downloaded yet
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_c1db1f63625ddf156a06ef0905d9abda.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_c1db1f63625ddf156a06ef0905d9abda.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg not downloaded yet
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_db96413b631396f4198dd5039be81b49.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_11980c5713f8ad6e3838445e8fafa173.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_11980c5713f8ad6e3838445e8fafa173.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg not downloaded yet
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_1574116328ab029d11448e1759b68d3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_2fdfd52f460b03206a6238b29ef151ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_8cb327caed781e539c186ec369d2d3cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_8cb327caed781e539c186ec369d2d3cd.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_aa9733311703afa0160d520a343cb6b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_aa9733311703afa0160d520a343cb6b6.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_fac002d51293314a5a6cccf248ddf3a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_fac002d51293314a5a6cccf248ddf3a3.jpg not downloaded yet
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_9d10e4b97cea153107ee4e9a4666e543.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM22028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_43ec8f5532b52d0af403f8d846533130.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_43ec8f5532b52d0af403f8d846533130.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_0c724bfae7eda7a136c9693de968153a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_0c724bfae7eda7a136c9693de968153a.jpg not downloaded yet
2026-03-28 11:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266c2f10>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg not downloaded yet
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_becd773dc0c88d507c58c75895550808.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_becd773dc0c88d507c58c75895550808.jpg not downloaded yet
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726626a50>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726787b50>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_db96413b631396f4198dd5039be81b49.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_db96413b631396f4198dd5039be81b49.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271c3bd0>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_1574116328ab029d11448e1759b68d3e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_1574116328ab029d11448e1759b68d3e.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72719fe90>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_2fdfd52f460b03206a6238b29ef151ea.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_2fdfd52f460b03206a6238b29ef151ea.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273d7b50>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_9d10e4b97cea153107ee4e9a4666e543.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_9d10e4b97cea153107ee4e9a4666e543.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_c1db1f63625ddf156a06ef0905d9abda.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72749ed10>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_fac002d51293314a5a6cccf248ddf3a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_aa9733311703afa0160d520a343cb6b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_8cb327caed781e539c186ec369d2d3cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD50482> (referer: https://www.auto1.com/v1/car-details-view/PD50482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727139ad0>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ72773> (referer: https://www.auto1.com/v1/car-details-view/JZ72773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726726290>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_c1db1f63625ddf156a06ef0905d9abda.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_c1db1f63625ddf156a06ef0905d9abda.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK57262> (referer: https://www.auto1.com/v1/car-details-view/KK57262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703f7d0>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_fac002d51293314a5a6cccf248ddf3a3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_fac002d51293314a5a6cccf248ddf3a3.jpg saved to cache
2026-03-28 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271c2c10>
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_aa9733311703afa0160d520a343cb6b6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_aa9733311703afa0160d520a343cb6b6.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726786c50>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_8cb327caed781e539c186ec369d2d3cd.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_8cb327caed781e539c186ec369d2d3cd.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbce581e-1f3e-58fd-a2bb-b999e0412c82 with identifier: PD50482
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbce581e-1f3e-58fd-a2bb-b999e0412c82 with scrape type 1
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_becd773dc0c88d507c58c75895550808.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_0c724bfae7eda7a136c9693de968153a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_0a96e66079ac7e6b516756916d77a26b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_0a96e66079ac7e6b516756916d77a26b.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW17140> (referer: https://www.auto1.com/v1/car-details-view/EW17140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f927c917-d873-5c9b-9da9-67951825afec with identifier: JZ72773
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f927c917-d873-5c9b-9da9-67951825afec with scrape type 1
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_43ec8f5532b52d0af403f8d846533130.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_98b8ebb29fd5465baa702f175ea23c94.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_98b8ebb29fd5465baa702f175ea23c94.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_de8cf257b08f9693ae147525f44082bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_de8cf257b08f9693ae147525f44082bf.jpg not downloaded yet
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e75f501-318f-5898-9be0-12b707da53e8 with identifier: KK57262
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e75f501-318f-5898-9be0-12b707da53e8 with scrape type 1
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_f664d21c6d67c2e88798259de53167d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_f664d21c6d67c2e88798259de53167d2.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_e283b0a2061cb128f880b228f645deca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_e283b0a2061cb128f880b228f645deca.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_790645944531e4a9f9030d913f697804.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_790645944531e4a9f9030d913f697804.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_11980c5713f8ad6e3838445e8fafa173.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_27517fac54c262bbdaf6e599fabff168.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_27517fac54c262bbdaf6e599fabff168.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg not downloaded yet
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_c9335626d96381251218b481a5c59bfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_c9335626d96381251218b481a5c59bfa.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg not downloaded yet
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f54d0>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_becd773dc0c88d507c58c75895550808.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_becd773dc0c88d507c58c75895550808.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274c5590>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72661e150>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_0c724bfae7eda7a136c9693de968153a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_0c724bfae7eda7a136c9693de968153a.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727110f10>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with identifier: EW17140
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with scrape type 1
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg not downloaded yet
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72744bbd0>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_43ec8f5532b52d0af403f8d846533130.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_43ec8f5532b52d0af403f8d846533130.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_f664d21c6d67c2e88798259de53167d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS10706> (referer: https://www.auto1.com/v1/car-details-view/JS10706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_13104fbdf9f725a11c532a3d604f827e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_13104fbdf9f725a11c532a3d604f827e.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg not downloaded yet
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_2e7a21b3e2f76d7066141f413619451e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_2e7a21b3e2f76d7066141f413619451e.jpg not downloaded yet
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274b8b50>
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252Fcf%252F37cf759e33c93257e3f64e7835353a61%252Fpa%252FUA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg saved to cache
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de5ab3c7-9045-57ad-abc0-758ab59faf1c
2026-03-28 11:00:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de5ab3c7-9045-57ad-abc0-758ab59faf1c, skipping ID generation
2026-03-28 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de5ab3c7-9045-57ad-abc0-758ab59faf1c with scrape type 1
2026-03-28 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de5ab3c7-9045-57ad-abc0-758ab59faf1c sending to next pipeline
2026-03-28 11:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de5ab3c7-9045-57ad-abc0-758ab59faf1c, identifier: UA24744
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727349790>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_11980c5713f8ad6e3838445e8fafa173.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_11980c5713f8ad6e3838445e8fafa173.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72e14af50>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_de8cf257b08f9693ae147525f44082bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_98b8ebb29fd5465baa702f175ea23c94.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU70316> (referer: https://www.auto1.com/v1/car-details-view/EU70316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LB38939/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de5ab3c7-9045-57ad-abc0-758ab59faf1c with identifier: UA24744
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de5ab3c7-9045-57ad-abc0-758ab59faf1c with identifier: UA24744
2026-03-28 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de5ab3c7-9045-57ad-abc0-758ab59faf1c with identifier: UA24744 to the API
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:23Z',
 'fuel_type': 'petrol',
 'id': 'de5ab3c7-9045-57ad-abc0-758ab59faf1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA24744',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 124572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_9d10e4b97cea153107ee4e9a4666e543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_208f2e401d1c36c68cdca5081b0e0b48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_aa1d6046ce97b2f886c6f5cd3dee53bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_fac002d51293314a5a6cccf248ddf3a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_0c724bfae7eda7a136c9693de968153a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de5ab3c7-9045-57ad-abc0-758ab59faf1c/de5ab3c7-9045-57ad-abc0-758ab59faf1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/cf/37cf759e33c93257e3f64e7835353a61/pa/UA24744_becd773dc0c88d507c58c75895550808.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2004}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA24744%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [auto1.es] INFO: Saving data for UA24744: {'created_time': 1774695641.692668, 'last_price_update_time': 1774695641.692679, 'auction_closing_time': 1774886003.0}
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UA24744') HTTP/1.1" 204 0
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267d7650>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270d5b90>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_f4614d6abaa41eb050505554be005c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_f4614d6abaa41eb050505554be005c9a.jpg not downloaded yet
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg not downloaded yet
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_77818bc176c992f4f073732ba6d08012.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_77818bc176c992f4f073732ba6d08012.jpg not downloaded yet
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC46387> (referer: https://www.auto1.com/v1/car-details-view/VC46387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72672eb50>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_f664d21c6d67c2e88798259de53167d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_f664d21c6d67c2e88798259de53167d2.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d5d5810>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72679b7d0>
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F46%252F9f4604151a7d4cdaeb1bd8cb5faccdea%252Fpa%252FES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg saved to cache
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed
2026-03-28 11:00:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4101ea8f-bade-5805-b5cc-e3cb62a583ed, skipping ID generation
2026-03-28 11:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed with scrape type 1
2026-03-28 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4101ea8f-bade-5805-b5cc-e3cb62a583ed sending to next pipeline
2026-03-28 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4101ea8f-bade-5805-b5cc-e3cb62a583ed, identifier: ES13897
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727241a50>
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg saved to cache
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d649573c-9d2d-5d31-89f9-8a77ad7ba72c with identifier: JS10706
2026-03-28 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c with scrape type 1
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg not downloaded yet
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_e283b0a2061cb128f880b228f645deca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_790645944531e4a9f9030d913f697804.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_27517fac54c262bbdaf6e599fabff168.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg not downloaded yet
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_88621aca26f479893e227fe3d7cb002d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_88621aca26f479893e227fe3d7cb002d.jpg not downloaded yet
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg not downloaded yet
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV29319> (referer: https://www.auto1.com/v1/car-details-view/RV29319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF61460> (referer: https://www.auto1.com/v1/car-details-view/MF61460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4101ea8f-bade-5805-b5cc-e3cb62a583ed with identifier: ES13897
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4101ea8f-bade-5805-b5cc-e3cb62a583ed with identifier: ES13897
2026-03-28 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4101ea8f-bade-5805-b5cc-e3cb62a583ed with identifier: ES13897 to the API
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:29Z',
 'fuel_type': 'diesel',
 'id': '4101ea8f-bade-5805-b5cc-e3cb62a583ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES13897',
 'listing': 'auction',
 'location': 'ES, Valladolid',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 160719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_4a018e3a1c7a8dd347a1026a871b332a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_c1db1f63625ddf156a06ef0905d9abda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_bd4c5cf916783dcb0f6208a7a77c3e1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_aa9733311703afa0160d520a343cb6b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_43ec8f5532b52d0af403f8d846533130.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4101ea8f-bade-5805-b5cc-e3cb62a583ed/4101ea8f-bade-5805-b5cc-e3cb62a583ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/46/9f4604151a7d4cdaeb1bd8cb5faccdea/pa/ES13897_1ea37b50d7fa8b2aeeb1947bf54cbe02.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-05-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 2.0 dCi Dynamique Komfort',
 'transmission': 'manual',
 'trim': 'Dynamique Komfort',
 'year': 2006}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES13897%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.es] INFO: Saving data for ES13897: {'created_time': 1774695642.7574, 'last_price_update_time': 1774695642.75741, 'auction_closing_time': 1774883849.0}
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES13897') HTTP/1.1" 204 0
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72652ea90>
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_de8cf257b08f9693ae147525f44082bf.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_de8cf257b08f9693ae147525f44082bf.jpg saved to cache
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266e4ed0>
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_98b8ebb29fd5465baa702f175ea23c94.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_98b8ebb29fd5465baa702f175ea23c94.jpg saved to cache
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e12c53-e15d-5c97-97c3-3fec5f717b40 with identifier: EU70316
2026-03-28 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e12c53-e15d-5c97-97c3-3fec5f717b40 with scrape type 1
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_64270107405d19620cb941d0b0b23a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64270107405d19620cb941d0b0b23a41.jpg not downloaded yet
2026-03-28 11:00:42 [auto1.es] INFO: Channel: 24h | Page: 6 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b899fe52793f914bd2820c3908a0167e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b899fe52793f914bd2820c3908a0167e.jpg not downloaded yet
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_3fd20a7802868d821566d93f419c03d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_3fd20a7802868d821566d93f419c03d2.jpg not downloaded yet
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg not downloaded yet
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg not downloaded yet
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_64a510dda02940fe7e097b5bb6398685.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64a510dda02940fe7e097b5bb6398685.jpg not downloaded yet
2026-03-28 11:00:42 [auto1.es] INFO: Found listing with ID: MY70573
2026-03-28 11:00:42 [auto1.es] INFO: Found listing with ID: MN37580
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN37580%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for MN37580: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: MK40110
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: MH26986
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: MD02288
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: LY48125
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY48125%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for LY48125: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: LB98236
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: KS49101
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS49101%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for KS49101: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: BP62909
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP62909%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for BP62909: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: WX65667
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX65667%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for WX65667: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: KH66285
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH66285%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for KH66285: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: KG64862
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG64862%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for KG64862: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: JH20520
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH20520%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for JH20520: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: JG48293
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: HY05176
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: HS16783
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS16783%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for HS16783: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: GU63395
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: GG14242
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG14242%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for GG14242: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: FF03006
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: FE10852
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE10852%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for FE10852: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: FD45689
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD45689%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for FD45689: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: ZC89924
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: EB04007
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB04007%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for EB04007: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: GG25367
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: DP25407
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP25407%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for DP25407: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: DK84530
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: DA34645
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA34645%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for DA34645: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: CY99272
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY99272%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for CY99272: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: CJ82848
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ82848%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for CJ82848: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: CC07404
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: ET28977
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: BZ61067
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ61067%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for BZ61067: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: BP46886
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP46886%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for BP46886: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: BJ99702
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: BE81339
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: AZ69629
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ69629%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for AZ69629: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: AU19829
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU19829%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for AU19829: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: XB68205
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB68205%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [auto1.es] INFO: Scrape type for XB68205: 0
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: FG81447
2026-03-28 11:00:43 [auto1.es] INFO: Found listing with ID: VV50506
2026-03-28 11:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f4cd0>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727231d50>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 453522e5-0a45-5f81-a0e4-58eec27c196e with identifier: VC46387
2026-03-28 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453522e5-0a45-5f81-a0e4-58eec27c196e with scrape type 1
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg not downloaded yet
2026-03-28 11:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_c9335626d96381251218b481a5c59bfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_2e7a21b3e2f76d7066141f413619451e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_e22d9327fd3e2feafc216118b5f1a497.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e22d9327fd3e2feafc216118b5f1a497.jpg not downloaded yet
2026-03-28 11:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265717d0>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_e283b0a2061cb128f880b228f645deca.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_e283b0a2061cb128f880b228f645deca.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265835d0>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_790645944531e4a9f9030d913f697804.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_790645944531e4a9f9030d913f697804.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265bf210>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265cefd0>
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_27517fac54c262bbdaf6e599fabff168.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_27517fac54c262bbdaf6e599fabff168.jpg saved to cache
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-28 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with scrape type 1
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_02975e13dfaa4e63e97eb24235dd6373.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_02975e13dfaa4e63e97eb24235dd6373.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_70a9b86a96de0d61b7b47f9ade0e5c68.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_70a9b86a96de0d61b7b47f9ade0e5c68.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_65e550ead8749063339bed10d89c9ee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_65e550ead8749063339bed10d89c9ee2.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_4c401c55dcc729f9602e19b88ec11095.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_4c401c55dcc729f9602e19b88ec11095.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_5cf4ce7d6c62618efc116aa6b0fb6a09.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_5cf4ce7d6c62618efc116aa6b0fb6a09.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_ae39fd973621feb6406e6f098e79bc95.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_ae39fd973621feb6406e6f098e79bc95.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_b1eccb2bb4a79d103c916e9ff80a6178.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_b1eccb2bb4a79d103c916e9ff80a6178.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_fc2808a98e20f189d5d638d6e0a3bed3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_fc2808a98e20f189d5d638d6e0a3bed3.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_eadc40b025f473882cabd9109a87de04.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_eadc40b025f473882cabd9109a87de04.jpg already downloaded
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fb7%252F5ab7f5773b11cf7c0fd1c22c88a3dcee%252Fpa%252FRV29319_1bbddfe894097e0a12e4ff2872700fc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_1bbddfe894097e0a12e4ff2872700fc7.jpg already downloaded
2026-03-28 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8, identifier: RV29319
2026-03-28 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with identifier: MF61460
2026-03-28 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with scrape type 1
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_9a4744f202195dfa944ec298b31bf2ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_9a4744f202195dfa944ec298b31bf2ad.jpg not downloaded yet
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_80aabd8fae8d526824ede14375b552c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_80aabd8fae8d526824ede14375b552c8.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_62f27b499594ba8b65f575a637598ce9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_62f27b499594ba8b65f575a637598ce9.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_76ebefb1adec14f876fca4107addccb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_76ebefb1adec14f876fca4107addccb7.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_e5f7e696329111d8268519e1607fd8e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_e5f7e696329111d8268519e1607fd8e0.jpg not downloaded yet
2026-03-28 11:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-28 11:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319
2026-03-28 11:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b1011a5-0579-5d76-8cc1-f27fcb78e0b8 with identifier: RV29319 to the API
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV29319>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:06:59Z',
 'fuel_type': 'petrol',
 'id': '1b1011a5-0579-5d76-8cc1-f27fcb78e0b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV29319',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Fiat',
 'model': '500',
 'odometer': 91463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_02975e13dfaa4e63e97eb24235dd6373.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_70a9b86a96de0d61b7b47f9ade0e5c68.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_65e550ead8749063339bed10d89c9ee2.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_4c401c55dcc729f9602e19b88ec11095.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_5cf4ce7d6c62618efc116aa6b0fb6a09.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_ae39fd973621feb6406e6f098e79bc95.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_b1eccb2bb4a79d103c916e9ff80a6178.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_fc2808a98e20f189d5d638d6e0a3bed3.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_eadc40b025f473882cabd9109a87de04.jpg',
                'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_1bbddfe894097e0a12e4ff2872700fc7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_02975e13dfaa4e63e97eb24235dd6373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_70a9b86a96de0d61b7b47f9ade0e5c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_65e550ead8749063339bed10d89c9ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_4c401c55dcc729f9602e19b88ec11095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_5cf4ce7d6c62618efc116aa6b0fb6a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_ae39fd973621feb6406e6f098e79bc95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_b1eccb2bb4a79d103c916e9ff80a6178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_fc2808a98e20f189d5d638d6e0a3bed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_eadc40b025f473882cabd9109a87de04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b1011a5-0579-5d76-8cc1-f27fcb78e0b8/1b1011a5-0579-5d76-8cc1-f27fcb78e0b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/b7/5ab7f5773b11cf7c0fd1c22c88a3dcee/pa/RV29319_1bbddfe894097e0a12e4ff2872700fc7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV29319%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [auto1.es] INFO: Saving data for RV29319: {'created_time': 1774695644.499627, 'last_price_update_time': 1774695644.49964, 'auction_closing_time': 1774883219.0}
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV29319') HTTP/1.1" 204 0
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_77818bc176c992f4f073732ba6d08012.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_13104fbdf9f725a11c532a3d604f827e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_edf427ee4178223dd1ced16eb4a39108.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_edf427ee4178223dd1ced16eb4a39108.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_0ab3f707b1ca7c73e8959844759ea148.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_0ab3f707b1ca7c73e8959844759ea148.jpg not downloaded yet
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727165090>
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg saved to cache
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726573b90>
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg saved to cache
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_81f51873fb196b897962275b0790f3f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_81f51873fb196b897962275b0790f3f4.jpg not downloaded yet
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM22028> (referer: https://www.auto1.com/v1/car-details-view/JM22028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265c0bd0>
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_c9335626d96381251218b481a5c59bfa.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_c9335626d96381251218b481a5c59bfa.jpg saved to cache
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727326110>
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_2e7a21b3e2f76d7066141f413619451e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_2e7a21b3e2f76d7066141f413619451e.jpg saved to cache
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_f4614d6abaa41eb050505554be005c9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg not downloaded yet
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_15f4087cbcccf50006e6b337135b97a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_15f4087cbcccf50006e6b337135b97a3.jpg not downloaded yet
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267c5f10>
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg saved to cache
2026-03-28 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg not downloaded yet
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg not downloaded yet
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266294d0>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_77818bc176c992f4f073732ba6d08012.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_77818bc176c992f4f073732ba6d08012.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727150ad0>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d2c63d0>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_13104fbdf9f725a11c532a3d604f827e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_13104fbdf9f725a11c532a3d604f827e.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_e3748665e64e34c2a68814c35f8af072.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_0a96e66079ac7e6b516756916d77a26b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b0a870f34dfe11a3da65563f7905db15.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b0a870f34dfe11a3da65563f7905db15.jpg not downloaded yet
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg not downloaded yet
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726792150>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727348c10>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_055fda591ccd95ac62cd17b994582538.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_70837d64fc4a6e58bc2392547615235c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_70837d64fc4a6e58bc2392547615235c.jpg not downloaded yet
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg not downloaded yet
2026-03-28 11:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf08721-8ec1-530e-90ed-35a91a34f6be with identifier: JM22028
2026-03-28 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf08721-8ec1-530e-90ed-35a91a34f6be with scrape type 1
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_c3261061746b62433376c9a6433fba64.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_c3261061746b62433376c9a6433fba64.jpg not downloaded yet
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274f9990>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F4f%252Ff14f496b41116d30a99b90cf02f633a6%252Fpa%252FJZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f927c917-d873-5c9b-9da9-67951825afec
2026-03-28 11:00:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f927c917-d873-5c9b-9da9-67951825afec, skipping ID generation
2026-03-28 11:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f927c917-d873-5c9b-9da9-67951825afec with scrape type 1
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f927c917-d873-5c9b-9da9-67951825afec sending to next pipeline
2026-03-28 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f927c917-d873-5c9b-9da9-67951825afec, identifier: JZ72773
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271cda50>
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_f4614d6abaa41eb050505554be005c9a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_f4614d6abaa41eb050505554be005c9a.jpg saved to cache
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_9a4744f202195dfa944ec298b31bf2ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e22d9327fd3e2feafc216118b5f1a497.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b899fe52793f914bd2820c3908a0167e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg not downloaded yet
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_1168ce41313e698e1a2a6925e4760800.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_1168ce41313e698e1a2a6925e4760800.jpg not downloaded yet
2026-03-28 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f927c917-d873-5c9b-9da9-67951825afec with identifier: JZ72773
2026-03-28 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f927c917-d873-5c9b-9da9-67951825afec with identifier: JZ72773
2026-03-28 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f927c917-d873-5c9b-9da9-67951825afec with identifier: JZ72773 to the API
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:57Z',
 'fuel_type': 'diesel',
 'id': 'f927c917-d873-5c9b-9da9-67951825afec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ72773',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 327487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_92cd3bfe2328b9b3d020e8f8eef1f3cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_de8cf257b08f9693ae147525f44082bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_28198e5552b317c6223c4c12af3a7c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_6ba56bec95766f0bb0f0e7a5f6618e10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_c9335626d96381251218b481a5c59bfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f927c917-d873-5c9b-9da9-67951825afec/f927c917-d873-5c9b-9da9-67951825afec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/4f/f14f496b41116d30a99b90cf02f633a6/pa/JZ72773_4f96e9a74e67d8d1919578d310561cbf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Drive 4x2',
 'transmission': 'manual',
 'trim': 'Drive 4x2',
 'year': 2010}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ72773%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.es] INFO: Saving data for JZ72773: {'created_time': 1774695646.105757, 'last_price_update_time': 1774695646.105768, 'auction_closing_time': 1774885737.0}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JZ72773') HTTP/1.1" 204 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg not downloaded yet
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg not downloaded yet
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_5e140089645795dcd432dcac6a6f4e02.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_5e140089645795dcd432dcac6a6f4e02.jpg not downloaded yet
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d601610>
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg saved to cache
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72670bad0>
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F2a%252Fa72a42336b39fa3a0a391cafb0b04bd7%252Fpa%252FPP51748_e3748665e64e34c2a68814c35f8af072.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_e3748665e64e34c2a68814c35f8af072.jpg saved to cache
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc
2026-03-28 11:00:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a54471b7-d2fb-5a6e-aabb-9d806a348dbc, skipping ID generation
2026-03-28 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc with scrape type 1
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54471b7-d2fb-5a6e-aabb-9d806a348dbc sending to next pipeline
2026-03-28 11:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a54471b7-d2fb-5a6e-aabb-9d806a348dbc, identifier: PP51748
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72730cd50>
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_0a96e66079ac7e6b516756916d77a26b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_0a96e66079ac7e6b516756916d77a26b.jpg saved to cache
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_edf427ee4178223dd1ced16eb4a39108.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_76ebefb1adec14f876fca4107addccb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64a510dda02940fe7e097b5bb6398685.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_e5f7e696329111d8268519e1607fd8e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_e698a4e4bab03cf619b61df32c74a879.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e698a4e4bab03cf619b61df32c74a879.jpg not downloaded yet
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg not downloaded yet
2026-03-28 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a54471b7-d2fb-5a6e-aabb-9d806a348dbc with identifier: PP51748
2026-03-28 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a54471b7-d2fb-5a6e-aabb-9d806a348dbc with identifier: PP51748
2026-03-28 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a54471b7-d2fb-5a6e-aabb-9d806a348dbc with identifier: PP51748 to the API
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_e3748665e64e34c2a68814c35f8af072.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:38Z',
 'fuel_type': 'diesel',
 'id': 'a54471b7-d2fb-5a6e-aabb-9d806a348dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP51748',
 'listing': 'auction',
 'location': 'ES, Cabrera de Mar',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 248924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_e3748665e64e34c2a68814c35f8af072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_61588fc1c81913b4becbb5ee6a3ba1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_11980c5713f8ad6e3838445e8fafa173.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_8cb327caed781e539c186ec369d2d3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_2aee076542b7ea27c5a0a1eb11c93493.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54471b7-d2fb-5a6e-aabb-9d806a348dbc/a54471b7-d2fb-5a6e-aabb-9d806a348dbc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/2a/a72a42336b39fa3a0a391cafb0b04bd7/pa/PP51748_a9d99c59bf63511f32c0cf6d9e5c6c54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Access',
 'transmission': 'automatic',
 'trim': 'Access',
 'year': 2011}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP51748%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [auto1.es] INFO: Saving data for PP51748: {'created_time': 1774695646.870921, 'last_price_update_time': 1774695646.870934, 'auction_closing_time': 1774883978.0}
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PP51748') HTTP/1.1" 204 0
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727324950>
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_055fda591ccd95ac62cd17b994582538.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_055fda591ccd95ac62cd17b994582538.jpg saved to cache
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710aa10>
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg saved to cache
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_0ab3f707b1ca7c73e8959844759ea148.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg not downloaded yet
2026-03-28 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg not downloaded yet
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_15f4087cbcccf50006e6b337135b97a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_62f27b499594ba8b65f575a637598ce9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_f49a604d05ff7a9102eb62c19612ec08.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_f49a604d05ff7a9102eb62c19612ec08.jpg not downloaded yet
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_14094fa3f84d19844c21175d06509bf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_14094fa3f84d19844c21175d06509bf8.jpg not downloaded yet
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727476710>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_9a4744f202195dfa944ec298b31bf2ad.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_9a4744f202195dfa944ec298b31bf2ad.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266efdd0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_e22d9327fd3e2feafc216118b5f1a497.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e22d9327fd3e2feafc216118b5f1a497.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727033750>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b899fe52793f914bd2820c3908a0167e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b899fe52793f914bd2820c3908a0167e.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg not downloaded yet
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_a271177b047973b62a744517bd5ac6e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_a271177b047973b62a744517bd5ac6e0.jpg not downloaded yet
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b98d055c0a44184666288843a8270144.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b98d055c0a44184666288843a8270144.jpg not downloaded yet
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_c6970a1836e5c13622299ffdf4914a81.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c6970a1836e5c13622299ffdf4914a81.jpg not downloaded yet
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c2cd0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_edf427ee4178223dd1ced16eb4a39108.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_edf427ee4178223dd1ced16eb4a39108.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272c9bd0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_76ebefb1adec14f876fca4107addccb7.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_76ebefb1adec14f876fca4107addccb7.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726522e10>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_64a510dda02940fe7e097b5bb6398685.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64a510dda02940fe7e097b5bb6398685.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d603c90>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_e5f7e696329111d8268519e1607fd8e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_e5f7e696329111d8268519e1607fd8e0.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_81f51873fb196b897962275b0790f3f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_dae187c149cd026aa2634eb12098034e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_dae187c149cd026aa2634eb12098034e.jpg not downloaded yet
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg not downloaded yet
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271b0a90>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271c9f10>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_0ab3f707b1ca7c73e8959844759ea148.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_0ab3f707b1ca7c73e8959844759ea148.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727169c50>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_15f4087cbcccf50006e6b337135b97a3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_15f4087cbcccf50006e6b337135b97a3.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c7bd0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_62f27b499594ba8b65f575a637598ce9.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_62f27b499594ba8b65f575a637598ce9.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_c3261061746b62433376c9a6433fba64.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_1168ce41313e698e1a2a6925e4760800.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_d6101fa574c2b658fcf99229fcac8025.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_d6101fa574c2b658fcf99229fcac8025.jpg not downloaded yet
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b0a870f34dfe11a3da65563f7905db15.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg not downloaded yet
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726533890>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271aab90>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72736ee50>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg not downloaded yet
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg not downloaded yet
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72734cb10>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_81f51873fb196b897962275b0790f3f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_81f51873fb196b897962275b0790f3f4.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LB38939> (referer: https://www.auto1.com/v1/car-details-view/LB38939/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72712ea50>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_c3261061746b62433376c9a6433fba64.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_c3261061746b62433376c9a6433fba64.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d7710>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726760bd0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg saved to cache
2026-03-28 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d50d0>
2026-03-28 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_1168ce41313e698e1a2a6925e4760800.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_1168ce41313e698e1a2a6925e4760800.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72712f550>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b0a870f34dfe11a3da65563f7905db15.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b0a870f34dfe11a3da65563f7905db15.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_14094fa3f84d19844c21175d06509bf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_a271177b047973b62a744517bd5ac6e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_5e140089645795dcd432dcac6a6f4e02.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg not downloaded yet
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e698a4e4bab03cf619b61df32c74a879.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_f49a604d05ff7a9102eb62c19612ec08.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg not downloaded yet
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg not downloaded yet
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d5850>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726548d90>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with identifier: LB38939
2026-03-28 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with scrape type 1
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_2549d1a857634bbe056085e3532a2e45.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_2549d1a857634bbe056085e3532a2e45.jpg not downloaded yet
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b98d055c0a44184666288843a8270144.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_269da6e6cce5457a1aa620a85f7ea230.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_269da6e6cce5457a1aa620a85f7ea230.jpg not downloaded yet
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c6970a1836e5c13622299ffdf4914a81.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_dae187c149cd026aa2634eb12098034e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg not downloaded yet
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726556cd0>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_14094fa3f84d19844c21175d06509bf8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_14094fa3f84d19844c21175d06509bf8.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703f890>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_a271177b047973b62a744517bd5ac6e0.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_a271177b047973b62a744517bd5ac6e0.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703fd90>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c7610>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_5e140089645795dcd432dcac6a6f4e02.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_5e140089645795dcd432dcac6a6f4e02.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c7350>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72726b150>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_e698a4e4bab03cf619b61df32c74a879.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e698a4e4bab03cf619b61df32c74a879.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:48 [auto1.es] INFO: Channel: 24h | Page: 7 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727474490>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_f49a604d05ff7a9102eb62c19612ec08.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_f49a604d05ff7a9102eb62c19612ec08.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72667a9d0>
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F54%252F0e54a00f3d2ecbc1e609975e7eee3f10%252Fpa%252FVC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg saved to cache
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 453522e5-0a45-5f81-a0e4-58eec27c196e
2026-03-28 11:00:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 453522e5-0a45-5f81-a0e4-58eec27c196e, skipping ID generation
2026-03-28 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 453522e5-0a45-5f81-a0e4-58eec27c196e with scrape type 1
2026-03-28 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 453522e5-0a45-5f81-a0e4-58eec27c196e sending to next pipeline
2026-03-28 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 453522e5-0a45-5f81-a0e4-58eec27c196e, identifier: VC46387
2026-03-28 11:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_b483cb505a67ced8f164247b6c3c05b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_b483cb505a67ced8f164247b6c3c05b9.jpg not downloaded yet
2026-03-28 11:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 453522e5-0a45-5f81-a0e4-58eec27c196e with identifier: VC46387
2026-03-28 11:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 453522e5-0a45-5f81-a0e4-58eec27c196e with identifier: VC46387
2026-03-28 11:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 453522e5-0a45-5f81-a0e4-58eec27c196e with identifier: VC46387 to the API
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'diesel',
 'id': '453522e5-0a45-5f81-a0e4-58eec27c196e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC46387',
 'listing': 'auction',
 'location': 'ES, Cornellà de Llobregat',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 290263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_515b0b2f29280b5e228e97c7f379d7a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_e5f7e696329111d8268519e1607fd8e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_81f51873fb196b897962275b0790f3f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_09cc7e64e9be1b4335a6741a5cbca2b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_89e5d3c77b20fb391708a4b4beb2bd34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_453522e5-0a45-5f81-a0e4-58eec27c196e/453522e5-0a45-5f81-a0e4-58eec27c196e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/54/0e54a00f3d2ecbc1e609975e7eee3f10/pa/VC46387_ea8a786eb0c571e0685961db7ea9ddb3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 2.0 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC46387%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Saving data for VC46387: {'created_time': 1774695649.453077, 'last_price_update_time': 1774695649.453088, 'auction_closing_time': 1774883362.0}
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC46387') HTTP/1.1" 204 0
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_d6101fa574c2b658fcf99229fcac8025.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: VV40051
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV40051%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for VV40051: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: NZ10183
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: EY94585
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: ZM37392
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: YV41467
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: VZ90970
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ90970%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for VZ90970: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: MR39300
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR39300%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for MR39300: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: JR92140
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR92140%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for JR92140: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: HK98944
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: HD07972
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD07972%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for HD07972: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: GX01105
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX01105%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for GX01105: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: CW13778
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: VG01013
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: MB17982
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: FK59567
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: UP38742
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: EP70954
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: CR30335
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR30335%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for CR30335: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: WJ83814
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: XW01779
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW01779%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for XW01779: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: LA45475
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA45475%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for LA45475: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: KU66562
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU66562%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for KU66562: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: RU59463
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: DG65204
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG65204%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for DG65204: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: BA49361
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA49361%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for BA49361: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: ZY46738
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY46738%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for ZY46738: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: JZ17995
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ17995%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for JZ17995: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: YW58225
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW58225%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for YW58225: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: ND95475
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: FJ32938
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: LZ97772
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: NW02170
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: TW11063
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW11063%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for TW11063: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: BR53004
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: TD39535
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD39535%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for TD39535: 0
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: AS54337
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: CV75612
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: TR12651
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: XS66014
2026-03-28 11:00:49 [auto1.es] INFO: Found listing with ID: RP64804
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP64804%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [auto1.es] INFO: Scrape type for RP64804: 0
2026-03-28 11:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_70837d64fc4a6e58bc2392547615235c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg not downloaded yet
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg not downloaded yet
2026-03-28 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726615ad0>
2026-03-28 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F58%252Fee58859a58208e214d97b090948b26d1%252Fpa%252FJS10706_b98d055c0a44184666288843a8270144.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b98d055c0a44184666288843a8270144.jpg saved to cache
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c
2026-03-28 11:00:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d649573c-9d2d-5d31-89f9-8a77ad7ba72c, skipping ID generation
2026-03-28 11:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c with scrape type 1
2026-03-28 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d649573c-9d2d-5d31-89f9-8a77ad7ba72c sending to next pipeline
2026-03-28 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d649573c-9d2d-5d31-89f9-8a77ad7ba72c, identifier: JS10706
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726671a90>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_c6970a1836e5c13622299ffdf4914a81.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c6970a1836e5c13622299ffdf4914a81.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72701c1d0>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271df0d0>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_dae187c149cd026aa2634eb12098034e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_dae187c149cd026aa2634eb12098034e.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267c9490>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d373f50>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_d6101fa574c2b658fcf99229fcac8025.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_d6101fa574c2b658fcf99229fcac8025.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72701d090>
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F08%252Ff7087143d474000143d42543a57765b0%252Fpa%252FMF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg saved to cache
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56
2026-03-28 11:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4b35bae-8b7f-5311-9b0c-5c0414d57a56, skipping ID generation
2026-03-28 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with scrape type 1
2026-03-28 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4b35bae-8b7f-5311-9b0c-5c0414d57a56 sending to next pipeline
2026-03-28 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b4b35bae-8b7f-5311-9b0c-5c0414d57a56, identifier: MF61460
2026-03-28 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d649573c-9d2d-5d31-89f9-8a77ad7ba72c with identifier: JS10706
2026-03-28 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d649573c-9d2d-5d31-89f9-8a77ad7ba72c with identifier: JS10706
2026-03-28 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d649573c-9d2d-5d31-89f9-8a77ad7ba72c with identifier: JS10706 to the API
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b98d055c0a44184666288843a8270144.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:01Z',
 'fuel_type': 'diesel',
 'id': 'd649573c-9d2d-5d31-89f9-8a77ad7ba72c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS10706',
 'listing': 'auction',
 'location': 'ES, Majadahonda, Madrid',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 230056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_93a79d40179eef07e49e9bdeb7a8eacf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b899fe52793f914bd2820c3908a0167e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e22d9327fd3e2feafc216118b5f1a497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_edf427ee4178223dd1ced16eb4a39108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_02d4b76f9bd7c07ef04cbb1d9c245074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b0a870f34dfe11a3da65563f7905db15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_4cc9980f6f02cd24ca8051e14c5afcd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_e698a4e4bab03cf619b61df32c74a879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_f49a604d05ff7a9102eb62c19612ec08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d649573c-9d2d-5d31-89f9-8a77ad7ba72c/d649573c-9d2d-5d31-89f9-8a77ad7ba72c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/58/ee58859a58208e214d97b090948b26d1/pa/JS10706_b98d055c0a44184666288843a8270144.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2019}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS10706%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.es] INFO: Saving data for JS10706: {'created_time': 1774695650.829308, 'last_price_update_time': 1774695650.829316, 'auction_closing_time': 1774884901.0}
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JS10706') HTTP/1.1" 204 0
2026-03-28 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with identifier: MF61460
2026-03-28 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with identifier: MF61460
2026-03-28 11:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b4b35bae-8b7f-5311-9b0c-5c0414d57a56 with identifier: MF61460 to the API
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:22Z',
 'fuel_type': 'diesel',
 'id': 'b4b35bae-8b7f-5311-9b0c-5c0414d57a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF61460',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 198605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_9a4744f202195dfa944ec298b31bf2ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_0ab3f707b1ca7c73e8959844759ea148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_15f4087cbcccf50006e6b337135b97a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c680d0e7fcf584b99804c7b1ca46e424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_1168ce41313e698e1a2a6925e4760800.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_e36b1f108cf2abdb36c8ebda32722b4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_14094fa3f84d19844c21175d06509bf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_c6970a1836e5c13622299ffdf4914a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_d6101fa574c2b658fcf99229fcac8025.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4b35bae-8b7f-5311-9b0c-5c0414d57a56/b4b35bae-8b7f-5311-9b0c-5c0414d57a56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/08/f7087143d474000143d42543a57765b0/pa/MF61460_5a2ae516457ab70942ce29e7ac92c6da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2016}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF61460%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [auto1.es] INFO: Saving data for MF61460: {'created_time': 1774695651.332909, 'last_price_update_time': 1774695651.332919, 'auction_closing_time': 1774884202.0}
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MF61460') HTTP/1.1" 204 0
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_3fd20a7802868d821566d93f419c03d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg not downloaded yet
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_2549d1a857634bbe056085e3532a2e45.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_80aabd8fae8d526824ede14375b552c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_648c5b18c29c8ecfdf857ada49c91927.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_648c5b18c29c8ecfdf857ada49c91927.jpg not downloaded yet
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72738b510>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266c2b90>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265aef90>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_70837d64fc4a6e58bc2392547615235c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_70837d64fc4a6e58bc2392547615235c.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727095ed0>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265af7d0>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_e0287ca4bfd3b251032413299785599a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_e0287ca4bfd3b251032413299785599a.jpg not downloaded yet
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_269da6e6cce5457a1aa620a85f7ea230.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64270107405d19620cb941d0b0b23a41.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_b483cb505a67ced8f164247b6c3c05b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_88621aca26f479893e227fe3d7cb002d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_27fcb544e43e89274a2801324d66fa42.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_27fcb544e43e89274a2801324d66fa42.jpg not downloaded yet
2026-03-28 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72700f490>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72719cfd0>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726708e50>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_3fd20a7802868d821566d93f419c03d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_3fd20a7802868d821566d93f419c03d2.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72714b650>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_2549d1a857634bbe056085e3532a2e45.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_2549d1a857634bbe056085e3532a2e45.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726613810>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726565150>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F84%252F3a8433e0bd30770b4e16c1aff74069e3%252Fpa%252FJM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg saved to cache
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccf08721-8ec1-530e-90ed-35a91a34f6be
2026-03-28 11:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccf08721-8ec1-530e-90ed-35a91a34f6be, skipping ID generation
2026-03-28 11:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf08721-8ec1-530e-90ed-35a91a34f6be with scrape type 1
2026-03-28 11:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccf08721-8ec1-530e-90ed-35a91a34f6be sending to next pipeline
2026-03-28 11:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccf08721-8ec1-530e-90ed-35a91a34f6be, identifier: JM22028
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274b4190>
2026-03-28 11:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_80aabd8fae8d526824ede14375b552c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_80aabd8fae8d526824ede14375b552c8.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273cdc90>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccf08721-8ec1-530e-90ed-35a91a34f6be with identifier: JM22028
2026-03-28 11:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccf08721-8ec1-530e-90ed-35a91a34f6be with identifier: JM22028
2026-03-28 11:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ccf08721-8ec1-530e-90ed-35a91a34f6be with identifier: JM22028 to the API
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'petrol',
 'id': 'ccf08721-8ec1-530e-90ed-35a91a34f6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM22028',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 79893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_c3261061746b62433376c9a6433fba64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_5e140089645795dcd432dcac6a6f4e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_0c9de521e0e2e061ffc68fdb86bda004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_a271177b047973b62a744517bd5ac6e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_6f8ec78edb575dcfde7dcbaa17a76be4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_ed1232d4c4e4e37f1cd8839b2e46d5e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_82a6c811e8b8324f8f67f7f463ff3266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_7fd2cfccd3d0453ae0a209b007ded66d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_06bbcf3b6dbfa861c8709a2751b8a769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf08721-8ec1-530e-90ed-35a91a34f6be/ccf08721-8ec1-530e-90ed-35a91a34f6be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/84/3a8433e0bd30770b4e16c1aff74069e3/pa/JM22028_3c0cc85190b0f9c7de01bd81f776fc45.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2011}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM22028%27 HTTP/1.1" 200 None
2026-03-28 11:00:52 [auto1.es] INFO: Saving data for JM22028: {'created_time': 1774695652.44776, 'last_price_update_time': 1774695652.44777, 'auction_closing_time': 1774883314.0}
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JM22028') HTTP/1.1" 204 0
2026-03-28 11:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_a8255cc452869be671bf80cbaac5d660.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727348190>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F5e%252Fc85e6eca8408b35dfe2810ce5ace3a59%252Fpa%252FEW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64
2026-03-28 11:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64, skipping ID generation
2026-03-28 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with scrape type 1
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 sending to next pipeline
2026-03-28 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64, identifier: EW17140
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703d350>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_269da6e6cce5457a1aa620a85f7ea230.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_269da6e6cce5457a1aa620a85f7ea230.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d5ffad0>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F7e%252Fa87e55e5c106aeb5b00f3520bbf29323%252Fpa%252FEU70316_64270107405d19620cb941d0b0b23a41.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64270107405d19620cb941d0b0b23a41.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b1e12c53-e15d-5c97-97c3-3fec5f717b40
2026-03-28 11:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b1e12c53-e15d-5c97-97c3-3fec5f717b40, skipping ID generation
2026-03-28 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e12c53-e15d-5c97-97c3-3fec5f717b40 with scrape type 1
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b1e12c53-e15d-5c97-97c3-3fec5f717b40 sending to next pipeline
2026-03-28 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1e12c53-e15d-5c97-97c3-3fec5f717b40, identifier: EU70316
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72734a850>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271a9d90>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_b483cb505a67ced8f164247b6c3c05b9.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_b483cb505a67ced8f164247b6c3c05b9.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703e450>
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F1a%252F091aa29996d612ee8bbc4e2c5358e75c%252Fpa%252FPD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg saved to cache
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbce581e-1f3e-58fd-a2bb-b999e0412c82
2026-03-28 11:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cbce581e-1f3e-58fd-a2bb-b999e0412c82, skipping ID generation
2026-03-28 11:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbce581e-1f3e-58fd-a2bb-b999e0412c82 with scrape type 1
2026-03-28 11:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cbce581e-1f3e-58fd-a2bb-b999e0412c82 sending to next pipeline
2026-03-28 11:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cbce581e-1f3e-58fd-a2bb-b999e0412c82, identifier: PD50482
2026-03-28 11:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703e310>
2026-03-28 11:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F3e%252Fcf3e115d92402c649df3f9a65f4858cb%252Fpa%252FKK57262_88621aca26f479893e227fe3d7cb002d.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_88621aca26f479893e227fe3d7cb002d.jpg saved to cache
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e75f501-318f-5898-9be0-12b707da53e8
2026-03-28 11:00:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e75f501-318f-5898-9be0-12b707da53e8, skipping ID generation
2026-03-28 11:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e75f501-318f-5898-9be0-12b707da53e8 with scrape type 1
2026-03-28 11:00:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e75f501-318f-5898-9be0-12b707da53e8 sending to next pipeline
2026-03-28 11:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e75f501-318f-5898-9be0-12b707da53e8, identifier: KK57262
2026-03-28 11:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_563f3f1d62ded6fa4682f601560505c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_f42a3141f490485bc21f4c2674e42760.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_94827a16a589db1ed451d4c9db84b754.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with identifier: EW17140
2026-03-28 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with identifier: EW17140
2026-03-28 11:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1fe332cc-8e43-5ad9-a76d-b313b6de3c64 with identifier: EW17140 to the API
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'petrol',
 'id': '1fe332cc-8e43-5ad9-a76d-b313b6de3c64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW17140',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 231374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_bb6385abf2a8590bf7d88a86bf0c5afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_2e7a21b3e2f76d7066141f413619451e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_77818bc176c992f4f073732ba6d08012.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_c8c52c4ce2b9e6c31df91954d2864a5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_336d2f463dc04f5caedde4b39e2bdbfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fe332cc-8e43-5ad9-a76d-b313b6de3c64/1fe332cc-8e43-5ad9-a76d-b313b6de3c64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/5e/c85e6eca8408b35dfe2810ce5ace3a59/pa/EW17140_62f27b499594ba8b65f575a637598ce9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.6 VTEC Top 4WD',
 'transmission': 'manual',
 'trim': 'VTEC Top 4WD',
 'year': 2001}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW17140%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.es] INFO: Saving data for EW17140: {'created_time': 1774695653.528581, 'last_price_update_time': 1774695653.52859, 'auction_closing_time': 1774886297.0}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EW17140') HTTP/1.1" 204 0
2026-03-28 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1e12c53-e15d-5c97-97c3-3fec5f717b40 with identifier: EU70316
2026-03-28 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1e12c53-e15d-5c97-97c3-3fec5f717b40 with identifier: EU70316
2026-03-28 11:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b1e12c53-e15d-5c97-97c3-3fec5f717b40 with identifier: EU70316 to the API
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64270107405d19620cb941d0b0b23a41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:02Z',
 'fuel_type': 'diesel',
 'id': 'b1e12c53-e15d-5c97-97c3-3fec5f717b40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU70316',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 249136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64270107405d19620cb941d0b0b23a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_64a510dda02940fe7e097b5bb6398685.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_76ebefb1adec14f876fca4107addccb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_f60fec0fc4f5ba1206496fd1462bdc8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_c2dbbe7feacd3723b9ba32be8ee260d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_70837d64fc4a6e58bc2392547615235c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_bb554c4d83a06b93fcf5b5d7541b3ff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_30fe7bb691b0fa64b43c349538f92c2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_9b9d3e0a6bfe51cb373904502a5c1f42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e12c53-e15d-5c97-97c3-3fec5f717b40/b1e12c53-e15d-5c97-97c3-3fec5f717b40_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/7e/a87e55e5c106aeb5b00f3520bbf29323/pa/EU70316_dae187c149cd026aa2634eb12098034e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2018}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU70316%27 HTTP/1.1" 200 None
2026-03-28 11:00:53 [auto1.es] INFO: Saving data for EU70316: {'created_time': 1774695653.923276, 'last_price_update_time': 1774695653.923287, 'auction_closing_time': 1774883762.0}
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EU70316') HTTP/1.1" 204 0
2026-03-28 11:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cbce581e-1f3e-58fd-a2bb-b999e0412c82 with identifier: PD50482
2026-03-28 11:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cbce581e-1f3e-58fd-a2bb-b999e0412c82 with identifier: PD50482
2026-03-28 11:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cbce581e-1f3e-58fd-a2bb-b999e0412c82 with identifier: PD50482 to the API
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'diesel',
 'id': 'cbce581e-1f3e-58fd-a2bb-b999e0412c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD50482',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 85368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_8d24b272ad4d3ac28323a3cc580dc01d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_0a96e66079ac7e6b516756916d77a26b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_98b8ebb29fd5465baa702f175ea23c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_e283b0a2061cb128f880b228f645deca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_27517fac54c262bbdaf6e599fabff168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_796aaef1696f6e209cc7bd7721d1ad26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_13104fbdf9f725a11c532a3d604f827e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_f4614d6abaa41eb050505554be005c9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_d5a182db9eccf7b0992d4d8dbb433223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cbce581e-1f3e-58fd-a2bb-b999e0412c82/cbce581e-1f3e-58fd-a2bb-b999e0412c82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/1a/091aa29996d612ee8bbc4e2c5358e75c/pa/PD50482_3fd20a7802868d821566d93f419c03d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi GT N1 L1',
 'transmission': 'manual',
 'trim': 'GT N1 L1',
 'year': 2022}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD50482%27 HTTP/1.1" 200 None
2026-03-28 11:00:54 [auto1.es] INFO: Saving data for PD50482: {'created_time': 1774695654.35051, 'last_price_update_time': 1774695654.35052, 'auction_closing_time': 1774884670.0}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD50482') HTTP/1.1" 204 0
2026-03-28 11:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e75f501-318f-5898-9be0-12b707da53e8 with identifier: KK57262
2026-03-28 11:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e75f501-318f-5898-9be0-12b707da53e8 with identifier: KK57262
2026-03-28 11:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e75f501-318f-5898-9be0-12b707da53e8 with identifier: KK57262 to the API
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_88621aca26f479893e227fe3d7cb002d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:26:39Z',
 'fuel_type': 'diesel',
 'id': '0e75f501-318f-5898-9be0-12b707da53e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK57262',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 270082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_f664d21c6d67c2e88798259de53167d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_790645944531e4a9f9030d913f697804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c71fc89bcde2c17ad275da6f9caba9f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_09e86ab4402be22afc554fa79a4ec0d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_d7dcc0e887b3cd22d73a7ac6c43595a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_a1b00cb23d243d5eb7477a63ec6fe55c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_88621aca26f479893e227fe3d7cb002d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_4ac4a342589edb26a764fb4cf41e1a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_80aabd8fae8d526824ede14375b552c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e75f501-318f-5898-9be0-12b707da53e8/0e75f501-318f-5898-9be0-12b707da53e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/3e/cf3e115d92402c649df3f9a65f4858cb/pa/KK57262_c189f1fc9b3310f66ceedd96f6a0e6b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK57262%27 HTTP/1.1" 200 None
2026-03-28 11:00:54 [auto1.es] INFO: Saving data for KK57262: {'created_time': 1774695654.737834, 'last_price_update_time': 1774695654.737844, 'auction_closing_time': 1774884399.0}
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KK57262') HTTP/1.1" 204 0
2026-03-28 11:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270d3d10>
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg saved to cache
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_e0287ca4bfd3b251032413299785599a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_648c5b18c29c8ecfdf857ada49c91927.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF19626> (referer: https://www.auto1.com/v1/car-details-view/FF19626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH42049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726792210>
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_a8255cc452869be671bf80cbaac5d660.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_a8255cc452869be671bf80cbaac5d660.jpg saved to cache
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:54 [auto1.es] INFO: Channel: 24h | Page: 8 | totalHits: 2549 | hits on page: 40
2026-03-28 11:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7a848e7a814d110d9723ae774a26d7ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727289350>
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_563f3f1d62ded6fa4682f601560505c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_563f3f1d62ded6fa4682f601560505c1.jpg saved to cache
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726628e10>
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fe0%252F4ee0e0f9679351f7587a6bf0a10f98a7%252Fpa%252FPT83214_f42a3141f490485bc21f4c2674e42760.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_f42a3141f490485bc21f4c2674e42760.jpg saved to cache
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc50a4f0-f7a3-5845-b5af-63f5eda26102
2026-03-28 11:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc50a4f0-f7a3-5845-b5af-63f5eda26102, skipping ID generation
2026-03-28 11:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc50a4f0-f7a3-5845-b5af-63f5eda26102 with scrape type 1
2026-03-28 11:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc50a4f0-f7a3-5845-b5af-63f5eda26102 sending to next pipeline
2026-03-28 11:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc50a4f0-f7a3-5845-b5af-63f5eda26102, identifier: PT83214
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727289190>
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_94827a16a589db1ed451d4c9db84b754.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_94827a16a589db1ed451d4c9db84b754.jpg saved to cache
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727164810>
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg saved to cache
2026-03-28 11:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: SZ95909
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: LW26471
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW26471%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for LW26471: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: HJ68220
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: ZZ18743
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: UF55082
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF55082%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for UF55082: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: RP55294
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP55294%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for RP55294: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: ZR84162
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR84162%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for ZR84162: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: YG81758
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG81758%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for YG81758: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: XZ87449
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: VL98218
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL98218%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for VL98218: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: PF61621
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF61621%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for PF61621: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: BE62587
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE62587%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for BE62587: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: SN94812
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: TS75802
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS75802%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for TS75802: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: TE16269
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: VH11492
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: XT74556
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT74556%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for XT74556: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: RK33204
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK33204%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for RK33204: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: HU25614
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: FC36055
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC36055%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for FC36055: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: UV92160
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: JX70017
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX70017%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for JX70017: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: ES45064
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: WH26152
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH26152%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for WH26152: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: NF35716
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: VU00284
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU00284%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for VU00284: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: BL83097
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: UB71741
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB71741%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for UB71741: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: KK78857
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK78857%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for KK78857: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: MW97614
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW97614%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for MW97614: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: YS92814
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: SN05978
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN05978%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for SN05978: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: AX08596
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: XC60196
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: ZG18454
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: JD79732
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JD79732%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for JD79732: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: ED57476
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED57476%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Scrape type for ED57476: 0
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: DK89612
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: WW09022
2026-03-28 11:00:55 [auto1.es] INFO: Found listing with ID: GC12859
2026-03-28 11:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc50a4f0-f7a3-5845-b5af-63f5eda26102 with identifier: PT83214
2026-03-28 11:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc50a4f0-f7a3-5845-b5af-63f5eda26102 with identifier: PT83214
2026-03-28 11:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc50a4f0-f7a3-5845-b5af-63f5eda26102 with identifier: PT83214 to the API
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_f42a3141f490485bc21f4c2674e42760.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'diesel',
 'id': 'bc50a4f0-f7a3-5845-b5af-63f5eda26102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT83214',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 101409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_db96413b631396f4198dd5039be81b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_bf68c4f9ef9d4ccc1d3f0c41281716cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_2fdfd52f460b03206a6238b29ef151ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_99697c4b66cc21e0b9be3cc17fdf82c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_1574116328ab029d11448e1759b68d3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_f42a3141f490485bc21f4c2674e42760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_563f3f1d62ded6fa4682f601560505c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_055fda591ccd95ac62cd17b994582538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_b60e45ff0756a7cef6ce1e79a7be9b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc50a4f0-f7a3-5845-b5af-63f5eda26102/bc50a4f0-f7a3-5845-b5af-63f5eda26102_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/e0/4ee0e0f9679351f7587a6bf0a10f98a7/pa/PT83214_82fe955a9613bf24eb7cd1b3f5e810e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT83214%27 HTTP/1.1" 200 None
2026-03-28 11:00:55 [auto1.es] INFO: Saving data for PT83214: {'created_time': 1774695655.939222, 'last_price_update_time': 1774695655.939235, 'auction_closing_time': 1774884797.0}
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT83214') HTTP/1.1" 204 0
2026-03-28 11:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_82f96121a0f35b33b78b412021d53a5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_f6c8dd88122267a4035aac3431f08e37.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_d9ff57fbb9318fdd48e17568a178af33.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_27fcb544e43e89274a2801324d66fa42.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72678f1d0>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72703d290>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_e0287ca4bfd3b251032413299785599a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_e0287ca4bfd3b251032413299785599a.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727365310>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_648c5b18c29c8ecfdf857ada49c91927.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_648c5b18c29c8ecfdf857ada49c91927.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with identifier: FF19626
2026-03-28 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with scrape type 1
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_2772f95f98131feb690850c7e2b8c0ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_2772f95f98131feb690850c7e2b8c0ee.jpg not downloaded yet
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726588110>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F2c%252Fcf2cb38dff7dbb797dcfd137f17e50d7%252Fpa%252FVA33750_7a848e7a814d110d9723ae774a26d7ce.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7a848e7a814d110d9723ae774a26d7ce.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc700c12-d0e3-5211-9202-9654f2c06c5e
2026-03-28 11:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc700c12-d0e3-5211-9202-9654f2c06c5e, skipping ID generation
2026-03-28 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc700c12-d0e3-5211-9202-9654f2c06c5e with scrape type 1
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc700c12-d0e3-5211-9202-9654f2c06c5e sending to next pipeline
2026-03-28 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cc700c12-d0e3-5211-9202-9654f2c06c5e, identifier: VA33750
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM10114> (referer: https://www.auto1.com/v1/car-details-view/MM10114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA09072/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cc700c12-d0e3-5211-9202-9654f2c06c5e with identifier: VA33750
2026-03-28 11:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cc700c12-d0e3-5211-9202-9654f2c06c5e with identifier: VA33750
2026-03-28 11:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cc700c12-d0e3-5211-9202-9654f2c06c5e with identifier: VA33750 to the API
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7a848e7a814d110d9723ae774a26d7ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 221,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.2L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:40:36Z',
 'fuel_type': 'diesel',
 'id': 'cc700c12-d0e3-5211-9202-9654f2c06c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA33750',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 95548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78205,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_dd5ea8f5aa3d0631af3c93ae474a48d7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75445,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7a848e7a814d110d9723ae774a26d7ce.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65308,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_94827a16a589db1ed451d4c9db84b754.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55653,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_c2215bd76ace6dc52307d476dc86392e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73612,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_6ac54fd4bd1e9d4735f82265a5d64535.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76536,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_34f46ab61b1651b9ee42ed71bbcc5b22.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59258,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_7bfcdd4cd43ec296634be76ff4423a86.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76982,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_fa2f3d5c9dc1bca39aae6cc10c55b16c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69666,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4ee05c5510e8bdb54baeaf0b1825c189.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc700c12-d0e3-5211-9202-9654f2c06c5e/cc700c12-d0e3-5211-9202-9654f2c06c5e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71865,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/2c/cf2cb38dff7dbb797dcfd137f17e50d7/pa/VA33750_4b914be6772fcca54140a340768e76f8.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2017}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA33750%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [auto1.es] INFO: Saving data for VA33750: {'created_time': 1774695656.757178, 'last_price_update_time': 1774695656.757188, 'auction_closing_time': 1774885236.0}
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VA33750') HTTP/1.1" 204 0
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726512a50>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6611786b4baf0e57598ed286737f3ab4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg not downloaded yet
2026-03-28 11:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8ce4d2ede319c99228416d0d9479b216.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273877d0>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F14%252F3a147156d0caa70d78cb56c2132f0694%252Fpa%252FNJ67875_82f96121a0f35b33b78b412021d53a5b.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_82f96121a0f35b33b78b412021d53a5b.jpg saved to cache
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca
2026-03-28 11:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecedec74-6c22-5b1c-ace7-9d406c2c48ca, skipping ID generation
2026-03-28 11:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca with scrape type 1
2026-03-28 11:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecedec74-6c22-5b1c-ace7-9d406c2c48ca sending to next pipeline
2026-03-28 11:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecedec74-6c22-5b1c-ace7-9d406c2c48ca, identifier: NJ67875
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726515ad0>
2026-03-28 11:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_f6c8dd88122267a4035aac3431f08e37.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_f6c8dd88122267a4035aac3431f08e37.jpg saved to cache
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72657ca10>
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_d9ff57fbb9318fdd48e17568a178af33.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_d9ff57fbb9318fdd48e17568a178af33.jpg saved to cache
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727135650>
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F0e%252Fe90ee48cbdfecba01591e7433f827d06%252Fpa%252FLB38939_27fcb544e43e89274a2801324d66fa42.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_27fcb544e43e89274a2801324d66fa42.jpg saved to cache
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324
2026-03-28 11:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324, skipping ID generation
2026-03-28 11:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with scrape type 1
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 sending to next pipeline
2026-03-28 11:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324, identifier: LB38939
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726511ed0>
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg saved to cache
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_38dece5c85384abbf54b6b94a86be646.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_42445d679af7f185e97b3b85df728fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_42445d679af7f185e97b3b85df728fb7.jpg not downloaded yet
2026-03-28 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecedec74-6c22-5b1c-ace7-9d406c2c48ca with identifier: NJ67875
2026-03-28 11:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecedec74-6c22-5b1c-ace7-9d406c2c48ca with identifier: NJ67875
2026-03-28 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecedec74-6c22-5b1c-ace7-9d406c2c48ca with identifier: NJ67875 to the API
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_82f96121a0f35b33b78b412021d53a5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'diesel',
 'id': 'ecedec74-6c22-5b1c-ace7-9d406c2c48ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ67875',
 'listing': 'auction',
 'location': 'ES, Seseña, Toledo',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 311334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_82f96121a0f35b33b78b412021d53a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_81bca8dfb8aaebdb85bfb0b78d08a3f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_a8255cc452869be671bf80cbaac5d660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_f0b0a0bdbfc87a1a55d6fce96ae5f054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_b50a156ca9e06df4306ffdccd5670632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecedec74-6c22-5b1c-ace7-9d406c2c48ca/ecedec74-6c22-5b1c-ace7-9d406c2c48ca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/14/3a147156d0caa70d78cb56c2132f0694/pa/NJ67875_20f0fad99a521595975a6261bbe7b858.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI 25 Aniversario',
 'transmission': 'manual',
 'trim': '25 Aniversario',
 'year': 2009}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ67875%27 HTTP/1.1" 200 None
2026-03-28 11:00:57 [auto1.es] INFO: Saving data for NJ67875: {'created_time': 1774695657.754031, 'last_price_update_time': 1774695657.754041, 'auction_closing_time': 1774882807.0}
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ67875') HTTP/1.1" 204 0
2026-03-28 11:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with identifier: LB38939
2026-03-28 11:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with identifier: LB38939
2026-03-28 11:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f2749b6-5043-5f4b-b52b-c0cd66ed3324 with identifier: LB38939 to the API
2026-03-28 11:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_27fcb544e43e89274a2801324d66fa42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:05:04Z',
 'fuel_type': 'petrol',
 'id': '3f2749b6-5043-5f4b-b52b-c0cd66ed3324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB38939',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 159200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_2549d1a857634bbe056085e3532a2e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_269da6e6cce5457a1aa620a85f7ea230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_28fb83565db34a2442dbfcb5ba64f9f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_b483cb505a67ced8f164247b6c3c05b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_19eeeedb43fe8e6f50711b1f9ba364f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_85410bd032f02d06f7ebedd1cb5a11e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_bde3e2ed7fd0caba5bccc8dc10661c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_648c5b18c29c8ecfdf857ada49c91927.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_e0287ca4bfd3b251032413299785599a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f2749b6-5043-5f4b-b52b-c0cd66ed3324/3f2749b6-5043-5f4b-b52b-c0cd66ed3324_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/0e/e90ee48cbdfecba01591e7433f827d06/pa/LB38939_27fcb544e43e89274a2801324d66fa42.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 Concept",
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2016}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB38939%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.es] INFO: Saving data for LB38939: {'created_time': 1774695658.186463, 'last_price_update_time': 1774695658.186478, 'auction_closing_time': 1774883104.0}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LB38939') HTTP/1.1" 204 0
2026-03-28 11:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 566bbb94-b2bb-574a-a6ca-936b146a278b with identifier: MM10114
2026-03-28 11:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566bbb94-b2bb-574a-a6ca-936b146a278b with scrape type 1
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg not downloaded yet
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a7668b9c040a0b8058d5144f366b4382.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f889f87c208c9c2c45032980f55207bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg not downloaded yet
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_f0e1fd8311e103590f121c954274e04c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f0e1fd8311e103590f121c954274e04c.jpg not downloaded yet
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d310590>
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_6611786b4baf0e57598ed286737f3ab4.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6611786b4baf0e57598ed286737f3ab4.jpg saved to cache
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72739d010>
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_8ce4d2ede319c99228416d0d9479b216.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8ce4d2ede319c99228416d0d9479b216.jpg saved to cache
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727168210>
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg saved to cache
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_2772f95f98131feb690850c7e2b8c0ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270bfd10>
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F8e%252F728e7b8f4ce0c801cfdb1606230ce391%252Fpa%252FAP47288_38dece5c85384abbf54b6b94a86be646.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_38dece5c85384abbf54b6b94a86be646.jpg saved to cache
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6454f313-04ef-55b3-9af3-1457e8f38e1d
2026-03-28 11:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6454f313-04ef-55b3-9af3-1457e8f38e1d, skipping ID generation
2026-03-28 11:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6454f313-04ef-55b3-9af3-1457e8f38e1d with scrape type 1
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6454f313-04ef-55b3-9af3-1457e8f38e1d sending to next pipeline
2026-03-28 11:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6454f313-04ef-55b3-9af3-1457e8f38e1d, identifier: AP47288
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_ba885d855a577493564c3783eeb70c7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_ba885d855a577493564c3783eeb70c7d.jpg not downloaded yet
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_8feed10873915668a9d8d622f8379933.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_8feed10873915668a9d8d622f8379933.jpg not downloaded yet
2026-03-28 11:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6454f313-04ef-55b3-9af3-1457e8f38e1d with identifier: AP47288
2026-03-28 11:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6454f313-04ef-55b3-9af3-1457e8f38e1d with identifier: AP47288
2026-03-28 11:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6454f313-04ef-55b3-9af3-1457e8f38e1d with identifier: AP47288 to the API
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_38dece5c85384abbf54b6b94a86be646.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'diesel',
 'id': '6454f313-04ef-55b3-9af3-1457e8f38e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP47288',
 'listing': 'auction',
 'location': 'ES, Basauri',
 'make': 'BMW',
 'model': '3er',
 'odometer': 115334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_38dece5c85384abbf54b6b94a86be646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_ec3f6f215325f492c67270a2e7f8824d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_077abad4212a6e110ce851a5dac50213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_090e6ea07426e162cc39c6b62419869f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_0b74b4f30efb2aa2632237b611adb2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cbc98961197373810b32779f2c5cd2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_6cf7063deec840b23b040538428019b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_146138bc721f2e518723c54cf5794ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_5032877013f92eda609b4851d5c70fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6454f313-04ef-55b3-9af3-1457e8f38e1d/6454f313-04ef-55b3-9af3-1457e8f38e1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/8e/728e7b8f4ce0c801cfdb1606230ce391/pa/AP47288_3b4749123fdc91d64c4a1c3d42167b9a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP47288%27 HTTP/1.1" 200 None
2026-03-28 11:00:58 [auto1.es] INFO: Saving data for AP47288: {'created_time': 1774695658.957028, 'last_price_update_time': 1774695658.957039, 'auction_closing_time': 1774885682.0}
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP47288') HTTP/1.1" 204 0
2026-03-28 11:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_35191f8978546e907f647df3eead7c41.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727387a10>
2026-03-28 11:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Ffd%252Fbafd58140d1d75b11ab56d0bdd1209e5%252Fpa%252FFR94321_a7668b9c040a0b8058d5144f366b4382.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a7668b9c040a0b8058d5144f366b4382.jpg saved to cache
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4
2026-03-28 11:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1055ecb8-31a8-5f15-a67e-daa70f2135c4, skipping ID generation
2026-03-28 11:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with scrape type 1
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1055ecb8-31a8-5f15-a67e-daa70f2135c4 sending to next pipeline
2026-03-28 11:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1055ecb8-31a8-5f15-a67e-daa70f2135c4, identifier: FR94321
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e6950>
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_f889f87c208c9c2c45032980f55207bd.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f889f87c208c9c2c45032980f55207bd.jpg saved to cache
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72652dc10>
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg saved to cache
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_ea6f967d459eb84e55df38649bbb6a65.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_f5005f5d0c934ab8f0029473f177dee9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_f5005f5d0c934ab8f0029473f177dee9.jpg not downloaded yet
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_e9993c9f90ca40498f12ae4771f619da.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_e9993c9f90ca40498f12ae4771f619da.jpg not downloaded yet
2026-03-28 11:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with identifier: FR94321
2026-03-28 11:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with identifier: FR94321
2026-03-28 11:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1055ecb8-31a8-5f15-a67e-daa70f2135c4 with identifier: FR94321 to the API
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a7668b9c040a0b8058d5144f366b4382.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:52:06Z',
 'fuel_type': 'diesel',
 'id': '1055ecb8-31a8-5f15-a67e-daa70f2135c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR94321',
 'listing': 'auction',
 'location': 'ES, Cáceres',
 'make': 'BMW',
 'model': '1er',
 'odometer': 238159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66142,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a7668b9c040a0b8058d5144f366b4382.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49944,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_25add4b207d1cd74a3b5ae97240db287.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58175,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b38d6449cb4613aa14eba770eeb8992b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49701,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_b673c5308d818d8e5a5461fc007028b7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50449,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_12a4385b00cbc19b11e471d48298f75a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61904,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_76d55d08eb5ab9cdbe787e155e290012.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50542,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_f6c8dd88122267a4035aac3431f08e37.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51827,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_d9ff57fbb9318fdd48e17568a178af33.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63404,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_9d253081d1c21d5a5354b0dc271cbaeb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1055ecb8-31a8-5f15-a67e-daa70f2135c4/1055ecb8-31a8-5f15-a67e-daa70f2135c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/fd/bafd58140d1d75b11ab56d0bdd1209e5/pa/FR94321_a2356103ab3bf8fd6e67d34592d55a5a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR94321%27 HTTP/1.1" 200 None
2026-03-28 11:00:59 [auto1.es] INFO: Saving data for FR94321: {'created_time': 1774695659.648576, 'last_price_update_time': 1774695659.648585, 'auction_closing_time': 1774885926.0}
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FR94321') HTTP/1.1" 204 0
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e9d50>
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_2772f95f98131feb690850c7e2b8c0ee.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_2772f95f98131feb690850c7e2b8c0ee.jpg saved to cache
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727474ed0>
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F69%252F5969bda41a75445990346edabe68133c%252Fpa%252FKE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg saved to cache
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b36783f2-0e21-5f0b-9032-497e29bc39d0
2026-03-28 11:00:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b36783f2-0e21-5f0b-9032-497e29bc39d0, skipping ID generation
2026-03-28 11:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36783f2-0e21-5f0b-9032-497e29bc39d0 with scrape type 1
2026-03-28 11:00:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b36783f2-0e21-5f0b-9032-497e29bc39d0 sending to next pipeline
2026-03-28 11:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b36783f2-0e21-5f0b-9032-497e29bc39d0, identifier: KE70928
2026-03-28 11:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b36783f2-0e21-5f0b-9032-497e29bc39d0 with identifier: KE70928
2026-03-28 11:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b36783f2-0e21-5f0b-9032-497e29bc39d0 with identifier: KE70928
2026-03-28 11:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b36783f2-0e21-5f0b-9032-497e29bc39d0 with identifier: KE70928 to the API
2026-03-28 11:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:44:23Z',
 'fuel_type': 'diesel',
 'id': 'b36783f2-0e21-5f0b-9032-497e29bc39d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE70928',
 'listing': 'auction',
 'location': 'ES, Almería',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 393854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_67e3b95eda503c0b1f06b54fe2be4563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_05d7ea72ffe83a6010610a61d8466f4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_4a286c64317a800439f075557ac8abfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_297be3d4a0fd6f9f8b73678aafb4ef0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_9f956f0f266e5d5b5564cae14a1247fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b36783f2-0e21-5f0b-9032-497e29bc39d0/b36783f2-0e21-5f0b-9032-497e29bc39d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/69/5969bda41a75445990346edabe68133c/pa/KE70928_8972ab9da2789048ece29a6760488d3c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE70928%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.es] INFO: Saving data for KE70928: {'created_time': 1774695660.206973, 'last_price_update_time': 1774695660.206983, 'auction_closing_time': 1774885463.0}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE70928') HTTP/1.1" 204 0
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8fed289f469800dd15cb2b743e275798.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_42445d679af7f185e97b3b85df728fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_356db9dc7b5e4c588be922558b045d54.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_356db9dc7b5e4c588be922558b045d54.jpg not downloaded yet
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP09375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA61536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274b4790>
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F2f%252F5b2f3ce060d685d8bc476fdc1b1ffec2%252Fpa%252FSY19830_35191f8978546e907f647df3eead7c41.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_35191f8978546e907f647df3eead7c41.jpg saved to cache
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9741df9d-ac05-5d57-b136-2052d064d27d
2026-03-28 11:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9741df9d-ac05-5d57-b136-2052d064d27d, skipping ID generation
2026-03-28 11:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9741df9d-ac05-5d57-b136-2052d064d27d with scrape type 1
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9741df9d-ac05-5d57-b136-2052d064d27d sending to next pipeline
2026-03-28 11:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9741df9d-ac05-5d57-b136-2052d064d27d, identifier: SY19830
2026-03-28 11:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF41535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD69274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL84711> (referer: https://www.auto1.com/v1/car-details-view/PL84711/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9741df9d-ac05-5d57-b136-2052d064d27d with identifier: SY19830
2026-03-28 11:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9741df9d-ac05-5d57-b136-2052d064d27d with identifier: SY19830
2026-03-28 11:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9741df9d-ac05-5d57-b136-2052d064d27d with identifier: SY19830 to the API
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_35191f8978546e907f647df3eead7c41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:54Z',
 'fuel_type': 'petrol',
 'id': '9741df9d-ac05-5d57-b136-2052d064d27d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY19830',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 169388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_44d9a91e44df0ce0a19285c3fab55918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_34b7f2b9405ad7a85b1a5a23e8de391e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d303a90f63f34b2a8242d58283d51829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_76b4009eef520caf9d1044ba59d279cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_19362ccdecdb93155f16207aa6be5cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_0be9f1eb22a98234075dc04a4904e255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_d97d4550bdd73738b2caa1515af8e43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_767fbdfc8c91f0dafd90d0353553744c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_46e4e6b13d5a849c0354c9c54299ebfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9741df9d-ac05-5d57-b136-2052d064d27d/9741df9d-ac05-5d57-b136-2052d064d27d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/2f/5b2f3ce060d685d8bc476fdc1b1ffec2/pa/SY19830_35191f8978546e907f647df3eead7c41.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2017}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY19830%27 HTTP/1.1" 200 None
2026-03-28 11:01:00 [auto1.es] INFO: Saving data for SY19830: {'created_time': 1774695660.778891, 'last_price_update_time': 1774695660.778902, 'auction_closing_time': 1774883514.0}
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY19830') HTTP/1.1" 204 0
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726775550>
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg saved to cache
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727199f90>
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F0c%252F280c027bcc3fbba3188c2480e78e3e4d%252Fpa%252FTS53334_ea6f967d459eb84e55df38649bbb6a65.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_ea6f967d459eb84e55df38649bbb6a65.jpg saved to cache
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f3724f40-5649-51e5-8f69-68386ee34def
2026-03-28 11:01:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f3724f40-5649-51e5-8f69-68386ee34def, skipping ID generation
2026-03-28 11:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3724f40-5649-51e5-8f69-68386ee34def with scrape type 1
2026-03-28 11:01:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f3724f40-5649-51e5-8f69-68386ee34def sending to next pipeline
2026-03-28 11:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3724f40-5649-51e5-8f69-68386ee34def, identifier: TS53334
2026-03-28 11:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f0e1fd8311e103590f121c954274e04c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg not downloaded yet
2026-03-28 11:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3724f40-5649-51e5-8f69-68386ee34def with identifier: TS53334
2026-03-28 11:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3724f40-5649-51e5-8f69-68386ee34def with identifier: TS53334
2026-03-28 11:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3724f40-5649-51e5-8f69-68386ee34def with identifier: TS53334 to the API
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_ea6f967d459eb84e55df38649bbb6a65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:00Z',
 'fuel_type': 'petrol',
 'id': 'f3724f40-5649-51e5-8f69-68386ee34def',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS53334',
 'listing': 'auction',
 'location': 'ES, Trasona',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 88017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_ea6f967d459eb84e55df38649bbb6a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_0bed44fbd3698a96d353833deae9c5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6f3f1a070b92fdb79edc16092f45a7be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f889f87c208c9c2c45032980f55207bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_6611786b4baf0e57598ed286737f3ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_52e0cd65a0c823406ab56596d267a3d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_f581eef95e869053fdef3b9eb9c724f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_15818813389322806b4432c83c430f17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_841747ddbd70871aafeb81107417515d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3724f40-5649-51e5-8f69-68386ee34def/f3724f40-5649-51e5-8f69-68386ee34def_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/0c/280c027bcc3fbba3188c2480e78e3e4d/pa/TS53334_032c5a49960e74d57d3c1f1e1ab7dfb8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR Go',
 'transmission': 'automatic',
 'trim': 'FR Go',
 'year': 2020}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS53334%27 HTTP/1.1" 200 None
2026-03-28 11:01:01 [auto1.es] INFO: Saving data for TS53334: {'created_time': 1774695661.425966, 'last_price_update_time': 1774695661.425978, 'auction_closing_time': 1774883940.0}
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS53334') HTTP/1.1" 204 0
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270dcb90>
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg saved to cache
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_ba885d855a577493564c3783eeb70c7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_8feed10873915668a9d8d622f8379933.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727032650>
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F57%252Fb55701dac3d1455c73df9a3dc66e6fb9%252Fpa%252FEG51857_8fed289f469800dd15cb2b743e275798.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8fed289f469800dd15cb2b743e275798.jpg saved to cache
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bb18b0d-d043-5f64-a2f1-e940d7115442
2026-03-28 11:01:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bb18b0d-d043-5f64-a2f1-e940d7115442, skipping ID generation
2026-03-28 11:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bb18b0d-d043-5f64-a2f1-e940d7115442 with scrape type 1
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bb18b0d-d043-5f64-a2f1-e940d7115442 sending to next pipeline
2026-03-28 11:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2bb18b0d-d043-5f64-a2f1-e940d7115442, identifier: EG51857
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270dee90>
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_42445d679af7f185e97b3b85df728fb7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_42445d679af7f185e97b3b85df728fb7.jpg saved to cache
2026-03-28 11:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_e9993c9f90ca40498f12ae4771f619da.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2bb18b0d-d043-5f64-a2f1-e940d7115442 with identifier: EG51857
2026-03-28 11:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2bb18b0d-d043-5f64-a2f1-e940d7115442 with identifier: EG51857
2026-03-28 11:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2bb18b0d-d043-5f64-a2f1-e940d7115442 with identifier: EG51857 to the API
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8fed289f469800dd15cb2b743e275798.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'diesel',
 'id': '2bb18b0d-d043-5f64-a2f1-e940d7115442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG51857',
 'listing': 'auction',
 'location': 'ES, Huelva',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 77462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_9e185ad8a380a5f3f47ec751a4cfb342.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_b325bfe81e049b425cdccbb8bdc5336e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_c3d648b7c97a1d7c038f9e29796b1a07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_ec32655ba627a0a2a0b899054d2d1adc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8fed289f469800dd15cb2b743e275798.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_e34c791e69cffc913e843dfccbf19bd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_71a5ef6ee76a58f97798d43b2cd2df93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_69cb7f2670843f2a6f9ae87bbcf23ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_8ce4d2ede319c99228416d0d9479b216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb18b0d-d043-5f64-a2f1-e940d7115442/2bb18b0d-d043-5f64-a2f1-e940d7115442_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/57/b55701dac3d1455c73df9a3dc66e6fb9/pa/EG51857_05c66bc6766b42e5c427eb88375c6212.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2017}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG51857%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.es] INFO: Saving data for EG51857: {'created_time': 1774695662.141345, 'last_price_update_time': 1774695662.141358, 'auction_closing_time': 1774884925.0}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG51857') HTTP/1.1" 204 0
2026-03-28 11:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-28 11:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e92a793c-beb5-5b36-baa4-38f1e0876a4a with scrape type 1
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e92a793c-beb5-5b36-baa4-38f1e0876a4a
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_97cabee778f9f1ccb3e1d4cedf7030cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_97cabee778f9f1ccb3e1d4cedf7030cb.jpg already downloaded
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_bc2c2dd1226ecb53a83f1ca05481bbd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_bc2c2dd1226ecb53a83f1ca05481bbd1.jpg already downloaded
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_c949fd7bdfc03f236cdd129e3ed16d4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_c949fd7bdfc03f236cdd129e3ed16d4d.jpg already downloaded
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_4938b877ffc201815831e624c108cad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_4938b877ffc201815831e624c108cad7.jpg already downloaded
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_40118513cfd9d93056c044cd816bcea3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_40118513cfd9d93056c044cd816bcea3.jpg already downloaded
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F06%252Fcf06a37c3fc5cb21a78172f8eeaf724f%252Fpa%252FPL84711_93b23f530f8bf3cb66f37d253c6668d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_93b23f530f8bf3cb66f37d253c6668d7.jpg already downloaded
2026-03-28 11:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e92a793c-beb5-5b36-baa4-38f1e0876a4a, identifier: PL84711
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_f5005f5d0c934ab8f0029473f177dee9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-28 11:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711
2026-03-28 11:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e92a793c-beb5-5b36-baa4-38f1e0876a4a with identifier: PL84711 to the API
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL84711>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:32Z',
 'fuel_type': 'diesel',
 'id': 'e92a793c-beb5-5b36-baa4-38f1e0876a4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL84711',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 342324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_97cabee778f9f1ccb3e1d4cedf7030cb.jpg',
                'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_bc2c2dd1226ecb53a83f1ca05481bbd1.jpg',
                'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_c949fd7bdfc03f236cdd129e3ed16d4d.jpg',
                'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_4938b877ffc201815831e624c108cad7.jpg',
                'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_40118513cfd9d93056c044cd816bcea3.jpg',
                'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_93b23f530f8bf3cb66f37d253c6668d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_97cabee778f9f1ccb3e1d4cedf7030cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_bc2c2dd1226ecb53a83f1ca05481bbd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_c949fd7bdfc03f236cdd129e3ed16d4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_4938b877ffc201815831e624c108cad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_40118513cfd9d93056c044cd816bcea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e92a793c-beb5-5b36-baa4-38f1e0876a4a/e92a793c-beb5-5b36-baa4-38f1e0876a4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/06/cf06a37c3fc5cb21a78172f8eeaf724f/pa/PL84711_93b23f530f8bf3cb66f37d253c6668d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL84711%27 HTTP/1.1" 200 None
2026-03-28 11:01:02 [auto1.es] INFO: Saving data for PL84711: {'created_time': 1774695662.76442, 'last_price_update_time': 1774695662.764433, 'auction_closing_time': 1774885712.0}
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PL84711') HTTP/1.1" 204 0
2026-03-28 11:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72653ae10>
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_f0e1fd8311e103590f121c954274e04c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f0e1fd8311e103590f121c954274e04c.jpg saved to cache
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_1c61a2ac231521194ac3b119715b9c32.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d7c90>
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg saved to cache
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72654d010>
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_ba885d855a577493564c3783eeb70c7d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_ba885d855a577493564c3783eeb70c7d.jpg saved to cache
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a2750>
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_8feed10873915668a9d8d622f8379933.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_8feed10873915668a9d8d622f8379933.jpg saved to cache
2026-03-28 11:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_385e9bc733e58c70f29acae77d740d33.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_444e0e7ef5a0646b9c2e358a201db797.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_356db9dc7b5e4c588be922558b045d54.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72730c510>
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_e9993c9f90ca40498f12ae4771f619da.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_e9993c9f90ca40498f12ae4771f619da.jpg saved to cache
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:03 [auto1.es] INFO: Channel: 24h | Page: 9 | totalHits: 2549 | hits on page: 40
2026-03-28 11:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72744a7d0>
2026-03-28 11:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fca%252Ff7ca2562c1845bcd739b358a573b9040%252Fpa%252FFF19626_f5005f5d0c934ab8f0029473f177dee9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_f5005f5d0c934ab8f0029473f177dee9.jpg saved to cache
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5
2026-03-28 11:01:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5, skipping ID generation
2026-03-28 11:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with scrape type 1
2026-03-28 11:01:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 sending to next pipeline
2026-03-28 11:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5, identifier: FF19626
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: KF74515
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF74515%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for KF74515: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: EE62782
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: YT10361
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: MZ62170
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: XE30764
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE30764%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for XE30764: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: SB32545
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB32545%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for SB32545: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: DT02195
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT02195%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for DT02195: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: RH33829
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH33829%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for RH33829: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: RC06010
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC06010%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for RC06010: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: HA27882
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA27882%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for HA27882: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: HU12913
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU12913%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for HU12913: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: ZN02005
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: FG15461
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG15461%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for FG15461: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: CK76032
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CK76032%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for CK76032: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: MN42055
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN42055%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for MN42055: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: UD00521
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD00521%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for UD00521: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: AJ03756
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: YY10601
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY10601%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for YY10601: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: SN13846
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN13846%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for SN13846: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: UZ91236
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ91236%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for UZ91236: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: GB32148
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: SJ07079
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: HR31272
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR31272%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for HR31272: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: JK63504
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK63504%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for JK63504: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: DE75422
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE75422%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for DE75422: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: GJ16527
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ16527%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for GJ16527: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: RN59573
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: MS33551
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: ZX65175
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX65175%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for ZX65175: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: DW68520
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: JM60139
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: HA89182
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: CB84377
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB84377%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for CB84377: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: CV84892
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV84892%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for CV84892: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: XW18745
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW18745%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for XW18745: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: ZS64271
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: XF30199
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: FD66244
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: FT05886
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT05886%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for FT05886: 0
2026-03-28 11:01:03 [auto1.es] INFO: Found listing with ID: PX41006
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX41006%27 HTTP/1.1" 200 None
2026-03-28 11:01:03 [auto1.es] INFO: Scrape type for PX41006: 0
2026-03-28 11:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with identifier: FF19626
2026-03-28 11:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with identifier: FF19626
2026-03-28 11:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ab2e1f7-558b-5da1-90c3-a32c9df436c5 with identifier: FF19626 to the API
2026-03-28 11:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_f5005f5d0c934ab8f0029473f177dee9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:47Z',
 'fuel_type': 'petrol',
 'id': '3ab2e1f7-558b-5da1-90c3-a32c9df436c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF19626',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 69837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_2772f95f98131feb690850c7e2b8c0ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_9d85a60a7b84c30c090c43dd0574b62a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_42445d679af7f185e97b3b85df728fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_8e809fb1ab4f0f836f95d6e53d0692c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_ba885d855a577493564c3783eeb70c7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ab2e1f7-558b-5da1-90c3-a32c9df436c5/3ab2e1f7-558b-5da1-90c3-a32c9df436c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ca/f7ca2562c1845bcd739b358a573b9040/pa/FF19626_f5005f5d0c934ab8f0029473f177dee9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTR Plus',
 'transmission': 'manual',
 'trim': 'VTR Plus',
 'year': 2005}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF19626%27 HTTP/1.1" 200 None
2026-03-28 11:01:04 [auto1.es] INFO: Saving data for FF19626: {'created_time': 1774695664.142901, 'last_price_update_time': 1774695664.142911, 'auction_closing_time': 1774885307.0}
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FF19626') HTTP/1.1" 204 0
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727010d90>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710b5d0>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_1c61a2ac231521194ac3b119715b9c32.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_1c61a2ac231521194ac3b119715b9c32.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267259d0>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_c8d451afc043112c5247ed316a3f98bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_cd274471995252795e7f16f8d32df617.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_e5efd775be543740d6bdcf083da33d9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72730fe90>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_385e9bc733e58c70f29acae77d740d33.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_385e9bc733e58c70f29acae77d740d33.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e2810>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_444e0e7ef5a0646b9c2e358a201db797.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_444e0e7ef5a0646b9c2e358a201db797.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72edc0790>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_356db9dc7b5e4c588be922558b045d54.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_356db9dc7b5e4c588be922558b045d54.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e1a90>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_fc217510a939b95bc1de07fbaa0929db.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ29812/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA09072> (referer: https://www.auto1.com/v1/car-details-view/FA09072/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_0021c49bd5548428e6d890c5676678fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f0f50>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_c8d451afc043112c5247ed316a3f98bc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_c8d451afc043112c5247ed316a3f98bc.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72657d350>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_cd274471995252795e7f16f8d32df617.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_cd274471995252795e7f16f8d32df617.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727470e10>
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F86%252F9e865f3eb52a94f89ffce0f0b97730f3%252Fpa%252FHX30017_e5efd775be543740d6bdcf083da33d9b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_e5efd775be543740d6bdcf083da33d9b.jpg saved to cache
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da2d7583-ecd9-56c2-ad3c-825b81a0b739
2026-03-28 11:01:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da2d7583-ecd9-56c2-ad3c-825b81a0b739, skipping ID generation
2026-03-28 11:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2d7583-ecd9-56c2-ad3c-825b81a0b739 with scrape type 1
2026-03-28 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da2d7583-ecd9-56c2-ad3c-825b81a0b739 sending to next pipeline
2026-03-28 11:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da2d7583-ecd9-56c2-ad3c-825b81a0b739, identifier: HX30017
2026-03-28 11:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72657d710>
2026-03-28 11:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F7f%252F8e7f6d71ac64d010e8054fa4eae04919%252Fpa%252FMM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg saved to cache
2026-03-28 11:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 566bbb94-b2bb-574a-a6ca-936b146a278b
2026-03-28 11:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 566bbb94-b2bb-574a-a6ca-936b146a278b, skipping ID generation
2026-03-28 11:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 566bbb94-b2bb-574a-a6ca-936b146a278b with scrape type 1
2026-03-28 11:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 566bbb94-b2bb-574a-a6ca-936b146a278b sending to next pipeline
2026-03-28 11:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 566bbb94-b2bb-574a-a6ca-936b146a278b, identifier: MM10114
2026-03-28 11:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da2d7583-ecd9-56c2-ad3c-825b81a0b739 with identifier: HX30017
2026-03-28 11:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da2d7583-ecd9-56c2-ad3c-825b81a0b739 with identifier: HX30017
2026-03-28 11:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da2d7583-ecd9-56c2-ad3c-825b81a0b739 with identifier: HX30017 to the API
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_e5efd775be543740d6bdcf083da33d9b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:34Z',
 'fuel_type': 'diesel',
 'id': 'da2d7583-ecd9-56c2-ad3c-825b81a0b739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX30017',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 290749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_e5efd775be543740d6bdcf083da33d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_8e618fbca8ce73cfcc78e5d18db30d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_444e0e7ef5a0646b9c2e358a201db797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_6c343936eb7105a04b40794828a02fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_528a2262952f220ce342ddb8f8606dcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2d7583-ecd9-56c2-ad3c-825b81a0b739/da2d7583-ecd9-56c2-ad3c-825b81a0b739_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/86/9e865f3eb52a94f89ffce0f0b97730f3/pa/HX30017_0426367151b7bf366f9283c3f7f41721.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2011}
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX30017%27 HTTP/1.1" 200 None
2026-03-28 11:01:05 [auto1.es] INFO: Saving data for HX30017: {'created_time': 1774695665.585362, 'last_price_update_time': 1774695665.585375, 'auction_closing_time': 1774884694.0}
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HX30017') HTTP/1.1" 204 0
2026-03-28 11:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 566bbb94-b2bb-574a-a6ca-936b146a278b with identifier: MM10114
2026-03-28 11:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 566bbb94-b2bb-574a-a6ca-936b146a278b with identifier: MM10114
2026-03-28 11:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 566bbb94-b2bb-574a-a6ca-936b146a278b with identifier: MM10114 to the API
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:46:49Z',
 'fuel_type': 'petrol',
 'id': '566bbb94-b2bb-574a-a6ca-936b146a278b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM10114',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 191221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f9a9b4b03cb8b9551f73bd6e39c23bcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_f0e1fd8311e103590f121c954274e04c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_8feed10873915668a9d8d622f8379933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_e9993c9f90ca40498f12ae4771f619da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_356db9dc7b5e4c588be922558b045d54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_566bbb94-b2bb-574a-a6ca-936b146a278b/566bbb94-b2bb-574a-a6ca-936b146a278b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/7f/8e7f6d71ac64d010e8054fa4eae04919/pa/MM10114_cf3b86281cb06af7ceae6198c947e6f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2000}
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM10114%27 HTTP/1.1" 200 None
2026-03-28 11:01:06 [auto1.es] INFO: Saving data for MM10114: {'created_time': 1774695666.091687, 'last_price_update_time': 1774695666.091701, 'auction_closing_time': 1774885609.0}
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MM10114') HTTP/1.1" 204 0
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c4e90>
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F02%252Fd0025c23282a46a93bd19c090ff40ac9%252Fpa%252FLX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg saved to cache
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0
2026-03-28 11:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0, skipping ID generation
2026-03-28 11:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with scrape type 1
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 sending to next pipeline
2026-03-28 11:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0, identifier: LX05735
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f36d0>
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_fc217510a939b95bc1de07fbaa0929db.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_fc217510a939b95bc1de07fbaa0929db.jpg saved to cache
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72716bed0>
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fa6%252Fafa696d59a74ffaa97453cf2ca62750b%252Fpa%252FPW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg saved to cache
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02
2026-03-28 11:01:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57dece04-3ad8-54c1-aa4b-108b14c0aa02, skipping ID generation
2026-03-28 11:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with scrape type 1
2026-03-28 11:01:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57dece04-3ad8-54c1-aa4b-108b14c0aa02 sending to next pipeline
2026-03-28 11:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57dece04-3ad8-54c1-aa4b-108b14c0aa02, identifier: PW93745
2026-03-28 11:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_cab8178208d203b1e90d1b44dc43c727.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:06 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 95 pages/min), scraped 43 items (at 43 items/min)
2026-03-28 11:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-28 11:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with identifier: LX05735
2026-03-28 11:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with identifier: LX05735
2026-03-28 11:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0 with identifier: LX05735 to the API
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:25:28Z',
 'fuel_type': 'diesel',
 'id': '8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX05735',
 'listing': 'auction',
 'location': 'ES, Majadahonda, Madrid',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 260140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_ec2388ac75ddf6b9d117a49eccb82d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_cd274471995252795e7f16f8d32df617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_385e9bc733e58c70f29acae77d740d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_1c61a2ac231521194ac3b119715b9c32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_c2bb9fbc3794d331fbcff136eb6c606f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0/8398c8bf-1fb7-5a86-85d1-ec0ae6a12bd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd0/02/d0025c23282a46a93bd19c090ff40ac9/pa/LX05735_2f5dda6c9acd56fc922c53583539b761.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX05735%27 HTTP/1.1" 200 None
2026-03-28 11:01:06 [auto1.es] INFO: Saving data for LX05735: {'created_time': 1774695666.796107, 'last_price_update_time': 1774695666.796126, 'auction_closing_time': 1774884328.0}
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX05735') HTTP/1.1" 204 0
2026-03-28 11:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with identifier: PW93745
2026-03-28 11:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with identifier: PW93745
2026-03-28 11:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57dece04-3ad8-54c1-aa4b-108b14c0aa02 with identifier: PW93745 to the API
2026-03-28 11:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.3L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:52:34Z',
 'fuel_type': 'petrol',
 'id': '57dece04-3ad8-54c1-aa4b-108b14c0aa02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW93745',
 'listing': 'auction',
 'location': 'ES, Córdoba',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 64868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_fc217510a939b95bc1de07fbaa0929db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_91ef886ab51f23101f6dce151c2f1c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_c8d451afc043112c5247ed316a3f98bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1b3b4a68978deb83102fb706d93fb2a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_1f61db147bbf0c90fbc39a78e2a5f4eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57dece04-3ad8-54c1-aa4b-108b14c0aa02/57dece04-3ad8-54c1-aa4b-108b14c0aa02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/a6/afa696d59a74ffaa97453cf2ca62750b/pa/PW93745_e7a80d8968adee54e0decb06b8919928.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 FIESTA Trend',
 'transmission': 'manual',
 'trim': 'FIESTA Trend',
 'year': 2002}
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW93745%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [auto1.es] INFO: Saving data for PW93745: {'created_time': 1774695667.227337, 'last_price_update_time': 1774695667.227349, 'auction_closing_time': 1774885954.0}
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PW93745') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de3c38e9-2596-56db-a6c4-4f33a80c87a2 with identifier: FA09072
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c38e9-2596-56db-a6c4-4f33a80c87a2 with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_4840813ad9c9ed36114989c20d461636.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_4840813ad9c9ed36114989c20d461636.jpg not downloaded yet
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_c14b950fb527f715186f2b3c03cd09c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_11d5485072d0196a455eb97930f4aae8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_490cc8d7925f707a128eaaad76ba8660.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f3890>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_0021c49bd5548428e6d890c5676678fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_0021c49bd5548428e6d890c5676678fc.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_2882366193f6ecf6a20c980331f267c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_59746674f55042897bf272d659ba8c46.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_0939cd127e94cd21b54567f9f49600dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_0939cd127e94cd21b54567f9f49600dc.jpg not downloaded yet
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP09375> (referer: https://www.auto1.com/v1/car-details-view/UP09375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF41535> (referer: https://www.auto1.com/v1/car-details-view/XF41535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD69274> (referer: https://www.auto1.com/v1/car-details-view/BD69274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA61536> (referer: https://www.auto1.com/v1/car-details-view/BA61536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH42049> (referer: https://www.auto1.com/v1/car-details-view/ZH42049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710a3d0>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_cab8178208d203b1e90d1b44dc43c727.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_cab8178208d203b1e90d1b44dc43c727.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_9adba6c0b6782eab20ca93738b51c587.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_e0941b4271bf62e087540e4d303e30d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_e0941b4271bf62e087540e4d303e30d9.jpg not downloaded yet
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_075380a9aa40f5573da7a7ad54e12cea.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_d35baedac43c3d8d63e4e740351d77b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d35baedac43c3d8d63e4e740351d77b6.jpg not downloaded yet
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726752e50>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_c14b950fb527f715186f2b3c03cd09c2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_c14b950fb527f715186f2b3c03cd09c2.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b18d0>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_11d5485072d0196a455eb97930f4aae8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_11d5485072d0196a455eb97930f4aae8.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274ec810>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_490cc8d7925f707a128eaaad76ba8660.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_490cc8d7925f707a128eaaad76ba8660.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b3d10>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271e4850>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg not downloaded yet
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72657c2d0>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_2882366193f6ecf6a20c980331f267c1.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_2882366193f6ecf6a20c980331f267c1.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726796d90>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_59746674f55042897bf272d659ba8c46.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_59746674f55042897bf272d659ba8c46.jpg saved to cache
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_4840813ad9c9ed36114989c20d461636.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_1eeb4006013139ebde157e53df6e2bca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_55c950feb062fdac19e98521965067a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg not downloaded yet
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca0d1ede-5762-5199-be14-0d1a264c6eac with identifier: UP09375
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca0d1ede-5762-5199-be14-0d1a264c6eac with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_0ead9263f5adf906585396383e52108b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_0ead9263f5adf906585396383e52108b.jpg not downloaded yet
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3605d95-06a7-5934-9815-701b728fb2f9 with identifier: XF41535
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3605d95-06a7-5934-9815-701b728fb2f9 with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_9f81f69af389841911dae3ecd9bd086f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_9f81f69af389841911dae3ecd9bd086f.jpg not downloaded yet
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3162a6c0-61e4-5e8f-a289-1555aa552440 with identifier: BD69274
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3162a6c0-61e4-5e8f-a289-1555aa552440 with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_0af67076b6c929fa68c8254136f90bc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_0af67076b6c929fa68c8254136f90bc9.jpg not downloaded yet
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a017f5-dc91-50d4-b267-3c15dee58635 with identifier: BA61536
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a017f5-dc91-50d4-b267-3c15dee58635 with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_212702e257d1f187433570f78357656e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_212702e257d1f187433570f78357656e.jpg not downloaded yet
2026-03-28 11:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87fcd4e6-549c-5314-9330-4347c848ff72 with identifier: ZH42049
2026-03-28 11:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87fcd4e6-549c-5314-9330-4347c848ff72 with scrape type 1
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg not downloaded yet
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d604710>
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_9adba6c0b6782eab20ca93738b51c587.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_9adba6c0b6782eab20ca93738b51c587.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726724190>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_075380a9aa40f5573da7a7ad54e12cea.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_075380a9aa40f5573da7a7ad54e12cea.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270d0d50>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_b69ab7b19e35509693b01a6a32102f6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_c04102bf22b1284d431d1549d8c031e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_c04102bf22b1284d431d1549d8c031e9.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_4a3053451834693bade795287951302b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4a3053451834693bade795287951302b.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_97bc0be099f7ac3e07039385983a3bd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_97bc0be099f7ac3e07039385983a3bd3.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg not downloaded yet
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_0939cd127e94cd21b54567f9f49600dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_e0941b4271bf62e087540e4d303e30d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d35baedac43c3d8d63e4e740351d77b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_5d810c370ea9ff4089108e099969739c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727201790>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_4840813ad9c9ed36114989c20d461636.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_4840813ad9c9ed36114989c20d461636.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271b7690>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_1eeb4006013139ebde157e53df6e2bca.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_1eeb4006013139ebde157e53df6e2bca.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726726b50>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72746d8d0>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727160590>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271b5b90>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_55c950feb062fdac19e98521965067a9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_55c950feb062fdac19e98521965067a9.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_02f91193bacbe7a261e4fb8282e84813.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_02f91193bacbe7a261e4fb8282e84813.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg not downloaded yet
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_cc464766e39d844540211f65f142e91f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_cc464766e39d844540211f65f142e91f.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_ec178a99c9f6ff6750fbe634a218873b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_ec178a99c9f6ff6750fbe634a218873b.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_339b1a2168a25a8ca8699955ca4014d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_339b1a2168a25a8ca8699955ca4014d5.jpg not downloaded yet
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_3494fee6a297063d30afdba047f4423d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_3494fee6a297063d30afdba047f4423d.jpg not downloaded yet
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d5d6310>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_b69ab7b19e35509693b01a6a32102f6c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_b69ab7b19e35509693b01a6a32102f6c.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727377910>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_0939cd127e94cd21b54567f9f49600dc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_0939cd127e94cd21b54567f9f49600dc.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272c4dd0>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_e0941b4271bf62e087540e4d303e30d9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_e0941b4271bf62e087540e4d303e30d9.jpg saved to cache
2026-03-28 11:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72663a310>
2026-03-28 11:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg saved to cache
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72719df10>
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_d35baedac43c3d8d63e4e740351d77b6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d35baedac43c3d8d63e4e740351d77b6.jpg saved to cache
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727377d90>
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_5d810c370ea9ff4089108e099969739c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_5d810c370ea9ff4089108e099969739c.jpg saved to cache
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_990c41a1651ce00915938d82e9196e61.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_9f81f69af389841911dae3ecd9bd086f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_88450a79c233cbc8283a75187b2cacd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_212702e257d1f187433570f78357656e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_0af67076b6c929fa68c8254136f90bc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_04bdbc3cea57e8dea55318690abe734c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_04bdbc3cea57e8dea55318690abe734c.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_59385f326a14b9c922bbf187bb43ca5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_59385f326a14b9c922bbf187bb43ca5a.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_9dee492d4365deca2ada489cf0508b5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9dee492d4365deca2ada489cf0508b5f.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_713f151075481e7d4442eb276626c3d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_713f151075481e7d4442eb276626c3d2.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg not downloaded yet
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272c4cd0>
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg saved to cache
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:09 [auto1.es] INFO: Channel: 24h | Page: 10 | totalHits: 2549 | hits on page: 40
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72713b490>
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg saved to cache
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_5c5ce7293d5b3269c68848ad4211771a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_5c5ce7293d5b3269c68848ad4211771a.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_fb00c988471a09344e80048a55c1e5bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_fb00c988471a09344e80048a55c1e5bf.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_c20143bb53cf2b953638cff31a82272d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_c20143bb53cf2b953638cff31a82272d.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_75f75168cede0873fda89f6ea0c843fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_75f75168cede0873fda89f6ea0c843fc.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg not downloaded yet
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_0ead9263f5adf906585396383e52108b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: EK90431
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK90431%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for EK90431: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: XH71672
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: GF68019
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF68019%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for GF68019: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: CV42772
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42772%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for CV42772: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: KK76277
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK76277%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for KK76277: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: MJ67844
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: YK01379
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK01379%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for YK01379: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: YC35747
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC35747%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for YC35747: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: VU50837
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU50837%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for VU50837: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: TF90504
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: SE93661
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE93661%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for SE93661: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: GH75768
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: CT45338
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: ZZ88385
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: MJ28673
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ28673%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for MJ28673: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: VL89620
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL89620%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for VL89620: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: XU17862
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU17862%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for XU17862: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: BF43819
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF43819%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for BF43819: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: KB84639
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: KK74689
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: HL23580
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL23580%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for HL23580: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: FZ71320
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: JV15285
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV15285%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for JV15285: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: GJ99683
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ99683%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for GJ99683: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: YZ57313
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: HA25095
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: LG37212
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG37212%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for LG37212: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: YK71465
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: NJ00425
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ00425%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for NJ00425: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: HZ04358
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ04358%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for HZ04358: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: NR06015
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR06015%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for NR06015: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: NB92875
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: JR86606
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR86606%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for JR86606: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: XU82709
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: ME40836
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME40836%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for ME40836: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: PL46605
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL46605%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for PL46605: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: KS53137
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS53137%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for KS53137: 0
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: VY63133
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: LU70143
2026-03-28 11:01:09 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR84391%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [auto1.es] INFO: Scrape type for CR84391: 0
2026-03-28 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ29812> (referer: https://www.auto1.com/v1/car-details-view/SJ29812/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg not downloaded yet
2026-03-28 11:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_a584d55ab6002f3edc1840c05672714e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a584d55ab6002f3edc1840c05672714e.jpg not downloaded yet
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726627bd0>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Ff8%252Fd6f8c33f925d9751c6b1079768d2df2b%252Fpa%252FEJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 896509ed-af98-59d5-a992-1153f6ad950f
2026-03-28 11:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 896509ed-af98-59d5-a992-1153f6ad950f, skipping ID generation
2026-03-28 11:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896509ed-af98-59d5-a992-1153f6ad950f with scrape type 1
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 896509ed-af98-59d5-a992-1153f6ad950f sending to next pipeline
2026-03-28 11:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 896509ed-af98-59d5-a992-1153f6ad950f, identifier: EJ15822
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726779890>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_990c41a1651ce00915938d82e9196e61.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_990c41a1651ce00915938d82e9196e61.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d305510>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_9f81f69af389841911dae3ecd9bd086f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_9f81f69af389841911dae3ecd9bd086f.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267aaa50>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_88450a79c233cbc8283a75187b2cacd0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_88450a79c233cbc8283a75187b2cacd0.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726553250>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272aa450>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_212702e257d1f187433570f78357656e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_212702e257d1f187433570f78357656e.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72713ad10>
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_0af67076b6c929fa68c8254136f90bc9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_0af67076b6c929fa68c8254136f90bc9.jpg saved to cache
2026-03-28 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_3494fee6a297063d30afdba047f4423d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 896509ed-af98-59d5-a992-1153f6ad950f with identifier: EJ15822
2026-03-28 11:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 896509ed-af98-59d5-a992-1153f6ad950f with identifier: EJ15822
2026-03-28 11:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 896509ed-af98-59d5-a992-1153f6ad950f with identifier: EJ15822 to the API
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:14Z',
 'fuel_type': 'diesel',
 'id': '896509ed-af98-59d5-a992-1153f6ad950f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ15822',
 'listing': 'auction',
 'location': 'ES, Alzira',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 204770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c37cade9269ffc3f531af08c5f777e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_1eeb4006013139ebde157e53df6e2bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_06a7980c3d13610346f40fae1bf2b2dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_2882366193f6ecf6a20c980331f267c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_11d5485072d0196a455eb97930f4aae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_896509ed-af98-59d5-a992-1153f6ad950f/896509ed-af98-59d5-a992-1153f6ad950f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/f8/d6f8c33f925d9751c6b1079768d2df2b/pa/EJ15822_7c7cfc05802c574f531109d93ae02056.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2008}
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ15822%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [auto1.es] INFO: Saving data for EJ15822: {'created_time': 1774695671.09989, 'last_price_update_time': 1774695671.099901, 'auction_closing_time': 1774885154.0}
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EJ15822') HTTP/1.1" 204 0
2026-03-28 11:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_02f91193bacbe7a261e4fb8282e84813.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_4d0e46a02bc81056ac559b433398f3f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4d0e46a02bc81056ac559b433398f3f3.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_5a5077fb58b103751e4d46af29f96209.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_5a5077fb58b103751e4d46af29f96209.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_32f5f8c2467530c6431200d14383c377.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_32f5f8c2467530c6431200d14383c377.jpg not downloaded yet
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA25667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX17648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726581610>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271cbbd0>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_0ead9263f5adf906585396383e52108b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_0ead9263f5adf906585396383e52108b.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d3187d0>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_339b1a2168a25a8ca8699955ca4014d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with identifier: SJ29812
2026-03-28 11:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with scrape type 1
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg not downloaded yet
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_ec178a99c9f6ff6750fbe634a218873b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_efc6bb93bb281d2a45f410c7717dc610.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_efc6bb93bb281d2a45f410c7717dc610.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_c3bb96b9524963be28b8a485ac48663a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_c3bb96b9524963be28b8a485ac48663a.jpg not downloaded yet
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_c20143bb53cf2b953638cff31a82272d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_75f75168cede0873fda89f6ea0c843fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_2634c1484a103ac29c33df8849a69931.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_2634c1484a103ac29c33df8849a69931.jpg not downloaded yet
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d6cc850>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_3494fee6a297063d30afdba047f4423d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_3494fee6a297063d30afdba047f4423d.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d305ad0>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270dd210>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72db219d0>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a8d50>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_02f91193bacbe7a261e4fb8282e84813.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_02f91193bacbe7a261e4fb8282e84813.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_6b8c5fd3cb954be7b2199af61d161705.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_6b8c5fd3cb954be7b2199af61d161705.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_b0c914de725c1f1e77a2141204f783ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_b0c914de725c1f1e77a2141204f783ab.jpg not downloaded yet
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg not downloaded yet
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_fb00c988471a09344e80048a55c1e5bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_5c5ce7293d5b3269c68848ad4211771a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266cd110>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_339b1a2168a25a8ca8699955ca4014d5.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_339b1a2168a25a8ca8699955ca4014d5.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726651a90>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_ec178a99c9f6ff6750fbe634a218873b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_ec178a99c9f6ff6750fbe634a218873b.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274d1c90>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72724d890>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg saved to cache
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7265354d0>
2026-03-28 11:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_c20143bb53cf2b953638cff31a82272d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_c20143bb53cf2b953638cff31a82272d.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726651250>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726726bd0>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_75f75168cede0873fda89f6ea0c843fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_75f75168cede0873fda89f6ea0c843fc.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9dee492d4365deca2ada489cf0508b5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg not downloaded yet
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a584d55ab6002f3edc1840c05672714e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_713f151075481e7d4442eb276626c3d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg not downloaded yet
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273abb50>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_fb00c988471a09344e80048a55c1e5bf.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_fb00c988471a09344e80048a55c1e5bf.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726775350>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_5c5ce7293d5b3269c68848ad4211771a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_5c5ce7293d5b3269c68848ad4211771a.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg not downloaded yet
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4d0e46a02bc81056ac559b433398f3f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_b0c914de725c1f1e77a2141204f783ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE22021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_32f5f8c2467530c6431200d14383c377.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710dd90>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726514e50>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_9dee492d4365deca2ada489cf0508b5f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9dee492d4365deca2ada489cf0508b5f.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272c96d0>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726752d50>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271b39d0>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_a584d55ab6002f3edc1840c05672714e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a584d55ab6002f3edc1840c05672714e.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72661fdd0>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_713f151075481e7d4442eb276626c3d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_713f151075481e7d4442eb276626c3d2.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_5a5077fb58b103751e4d46af29f96209.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_59385f326a14b9c922bbf187bb43ca5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_6b8c5fd3cb954be7b2199af61d161705.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_2634c1484a103ac29c33df8849a69931.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72674ecd0>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_4d0e46a02bc81056ac559b433398f3f3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4d0e46a02bc81056ac559b433398f3f3.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f0a10>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267eb790>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_b0c914de725c1f1e77a2141204f783ab.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_b0c914de725c1f1e77a2141204f783ab.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f2510>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_32f5f8c2467530c6431200d14383c377.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_32f5f8c2467530c6431200d14383c377.jpg saved to cache
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_c3bb96b9524963be28b8a485ac48663a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267d4850>
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_5a5077fb58b103751e4d46af29f96209.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_5a5077fb58b103751e4d46af29f96209.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272e74d0>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_59385f326a14b9c922bbf187bb43ca5a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_59385f326a14b9c922bbf187bb43ca5a.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272f1ed0>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266cdd50>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:13 [auto1.es] INFO: Channel: 24h | Page: 11 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72c1ffe10>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_6b8c5fd3cb954be7b2199af61d161705.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_6b8c5fd3cb954be7b2199af61d161705.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a8d50>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_2634c1484a103ac29c33df8849a69931.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_2634c1484a103ac29c33df8849a69931.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267a9390>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: CR84391
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR84391%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for CR84391: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: TR46498
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR46498%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for TR46498: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: AZ98699
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: RE19681
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: CG55928
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG55928%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for CG55928: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: DC47971
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: ZZ18199
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: LW73612
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: MT83706
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: FT39942
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT39942%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for FT39942: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: TL79249
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL79249%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for TL79249: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: NW09077
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: MD28950
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD28950%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for MD28950: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: XN80961
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: YT02265
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT02265%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for YT02265: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: PU95944
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: BD22709
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: BK80752
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK80752%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for BK80752: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: JE80773
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE80773%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for JE80773: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: TT52004
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TT52004%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for TT52004: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: GW48537
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW48537%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for GW48537: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: KL24436
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL24436%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for KL24436: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: JP19432
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19432%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for JP19432: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: XG96311
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: TV58646
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV58646%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for TV58646: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: CS77743
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: RW68168
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: KM60868
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: DL91172
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL91172%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for DL91172: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: NY08728
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY08728%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for NY08728: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: CH99472
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH99472%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for CH99472: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: AS02547
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS02547%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for AS02547: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: FZ98481
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: YK45669
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: EM05471
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: PM27944
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM27944%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for PM27944: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: NA38669
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: EJ11744
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ11744%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for EJ11744: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: EE23918
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE23918%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [auto1.es] INFO: Scrape type for EE23918: 0
2026-03-28 11:01:13 [auto1.es] INFO: Found listing with ID: LL51979
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_cc464766e39d844540211f65f142e91f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_efc6bb93bb281d2a45f410c7717dc610.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_04bdbc3cea57e8dea55318690abe734c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_97bc0be099f7ac3e07039385983a3bd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266621d0>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727104c10>
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F60%252F1060fb7d9b1a1ebab6a35c1fd2e71283%252Fpa%252FZH42049_c3bb96b9524963be28b8a485ac48663a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_c3bb96b9524963be28b8a485ac48663a.jpg saved to cache
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87fcd4e6-549c-5314-9330-4347c848ff72
2026-03-28 11:01:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87fcd4e6-549c-5314-9330-4347c848ff72, skipping ID generation
2026-03-28 11:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87fcd4e6-549c-5314-9330-4347c848ff72 with scrape type 1
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87fcd4e6-549c-5314-9330-4347c848ff72 sending to next pipeline
2026-03-28 11:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87fcd4e6-549c-5314-9330-4347c848ff72, identifier: ZH42049
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72c222010>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87fcd4e6-549c-5314-9330-4347c848ff72 with identifier: ZH42049
2026-03-28 11:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87fcd4e6-549c-5314-9330-4347c848ff72 with identifier: ZH42049
2026-03-28 11:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87fcd4e6-549c-5314-9330-4347c848ff72 with identifier: ZH42049 to the API
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_c3bb96b9524963be28b8a485ac48663a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:46Z',
 'fuel_type': 'diesel',
 'id': '87fcd4e6-549c-5314-9330-4347c848ff72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH42049',
 'listing': 'auction',
 'location': 'ES, Viladecans,Barcelona',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 180727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_317c11633d02c333c4dd0ab871cb0c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_62a710819b185de6e08cdbc4fd1325cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_ef23e78dd3c28989185b1a5037956bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_3494fee6a297063d30afdba047f4423d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_fa7f04512734f83d71c96ea3cfffe287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a542b2ab0ff2d055b84eead7e0df8a6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_a584d55ab6002f3edc1840c05672714e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_32f5f8c2467530c6431200d14383c377.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_c3bb96b9524963be28b8a485ac48663a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87fcd4e6-549c-5314-9330-4347c848ff72/87fcd4e6-549c-5314-9330-4347c848ff72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/60/1060fb7d9b1a1ebab6a35c1fd2e71283/pa/ZH42049_b0c914de725c1f1e77a2141204f783ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi GT-Style',
 'transmission': 'manual',
 'trim': 'GT-Style',
 'year': 2014}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH42049%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [auto1.es] INFO: Saving data for ZH42049: {'created_time': 1774695674.46471, 'last_price_update_time': 1774695674.464719, 'auction_closing_time': 1774882846.0}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH42049') HTTP/1.1" 204 0
2026-03-28 11:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX17648> (referer: https://www.auto1.com/v1/car-details-view/NX17648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA25667> (referer: https://www.auto1.com/v1/car-details-view/XA25667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273aae50>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_cc464766e39d844540211f65f142e91f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_cc464766e39d844540211f65f142e91f.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72651da10>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72728bed0>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72651c650>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_efc6bb93bb281d2a45f410c7717dc610.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_efc6bb93bb281d2a45f410c7717dc610.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272cbc90>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_04bdbc3cea57e8dea55318690abe734c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_04bdbc3cea57e8dea55318690abe734c.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727342710>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c10e00dda7dbec937d241868c7aacbf%252Fpa%252FBA61536_97bc0be099f7ac3e07039385983a3bd3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_97bc0be099f7ac3e07039385983a3bd3.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60a017f5-dc91-50d4-b267-3c15dee58635
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60a017f5-dc91-50d4-b267-3c15dee58635, skipping ID generation
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a017f5-dc91-50d4-b267-3c15dee58635 with scrape type 1
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60a017f5-dc91-50d4-b267-3c15dee58635 sending to next pipeline
2026-03-28 11:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60a017f5-dc91-50d4-b267-3c15dee58635, identifier: BA61536
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c6ed0>
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd2%252F88d21aa5240c405a8fb4fa17c612eec7%252Fpa%252FSJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg saved to cache
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225, skipping ID generation
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with scrape type 1
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 sending to next pipeline
2026-03-28 11:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225, identifier: SJ29812
2026-03-28 11:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72749f290>
2026-03-28 11:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg saved to cache
2026-03-28 11:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4a3053451834693bade795287951302b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_c04102bf22b1284d431d1549d8c031e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60a017f5-dc91-50d4-b267-3c15dee58635 with identifier: BA61536
2026-03-28 11:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60a017f5-dc91-50d4-b267-3c15dee58635 with identifier: BA61536
2026-03-28 11:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60a017f5-dc91-50d4-b267-3c15dee58635 with identifier: BA61536 to the API
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_97bc0be099f7ac3e07039385983a3bd3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:21Z',
 'fuel_type': 'diesel',
 'id': '60a017f5-dc91-50d4-b267-3c15dee58635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA61536',
 'listing': 'auction',
 'location': 'ES, Logroño',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 197927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_212702e257d1f187433570f78357656e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_97bc0be099f7ac3e07039385983a3bd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_a256720a3a98a0c3c3f0e9e5c707c6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_339b1a2168a25a8ca8699955ca4014d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_713f151075481e7d4442eb276626c3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_75f75168cede0873fda89f6ea0c843fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_b3ff51b34ff7ae3420dfefc4fd7153e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_5a5077fb58b103751e4d46af29f96209.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_d30ba5ae1cd8e9b2444acd72a7232247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60a017f5-dc91-50d4-b267-3c15dee58635/60a017f5-dc91-50d4-b267-3c15dee58635_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c10e00dda7dbec937d241868c7aacbf/pa/BA61536_3ce8a5de8f964a0b388679a26b6f80f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA61536%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [auto1.es] INFO: Saving data for BA61536: {'created_time': 1774695675.477014, 'last_price_update_time': 1774695675.477026, 'auction_closing_time': 1774882881.0}
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BA61536') HTTP/1.1" 204 0
2026-03-28 11:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with identifier: SJ29812
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 11:01:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with identifier: SJ29812
2026-03-28 11:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225 with identifier: SJ29812 to the API
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:32Z',
 'fuel_type': 'diesel',
 'id': 'ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ29812',
 'listing': 'auction',
 'location': 'ES, Sabadell',
 'make': 'Seat',
 'model': 'Altea XL',
 'odometer': 255218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_64f7d6804f8fa81ae482c65d31ad2148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_2634c1484a103ac29c33df8849a69931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_95d1f3ea7fc5737c2f55c64fd3570f9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7e8d2cc90b5ec08c5b16430e2d379151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_262a9bcc171869896dd4d52c7cf3854f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225/ec20fb3a-f796-54c7-b7ea-1ffc0dfc0225_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d2/88d21aa5240c405a8fb4fa17c612eec7/pa/SJ29812_7b598ad1c58ee150e78b6647d1d03d97.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Altea XL 1.9 TDI Stylance Style',
 'transmission': 'manual',
 'trim': 'Stylance Style',
 'year': 2006}
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ29812%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [auto1.es] INFO: Saving data for SJ29812: {'created_time': 1774695675.995339, 'last_price_update_time': 1774695675.995348, 'auction_closing_time': 1774883372.0}
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SJ29812') HTTP/1.1" 204 0
2026-03-28 11:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_8dfe056ba22f11c51fc6870d341851fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE22021> (referer: https://www.auto1.com/v1/car-details-view/GE22021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with identifier: NX17648
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_918b1db31eadb77863d9b0faa561928d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_918b1db31eadb77863d9b0faa561928d.jpg not downloaded yet
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cf64777-3c4e-5195-8417-fc60cc76abab with identifier: XA25667
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf64777-3c4e-5195-8417-fc60cc76abab with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_f7206a1b76ec127db20d624d0998b4c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_f7206a1b76ec127db20d624d0998b4c5.jpg not downloaded yet
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d602310>
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2d%252F2f2dcf5f2b627d0022f15c7e0a93eca5%252Fpa%252FXF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg saved to cache
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3605d95-06a7-5934-9815-701b728fb2f9
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3605d95-06a7-5934-9815-701b728fb2f9, skipping ID generation
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3605d95-06a7-5934-9815-701b728fb2f9 with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3605d95-06a7-5934-9815-701b728fb2f9 sending to next pipeline
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c3605d95-06a7-5934-9815-701b728fb2f9, identifier: XF41535
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72674f3d0>
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fa9%252F09a903a7f59fdb94bb7ab38570b4a414%252Fpa%252FBD69274_4a3053451834693bade795287951302b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4a3053451834693bade795287951302b.jpg saved to cache
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3162a6c0-61e4-5e8f-a289-1555aa552440
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3162a6c0-61e4-5e8f-a289-1555aa552440, skipping ID generation
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3162a6c0-61e4-5e8f-a289-1555aa552440 with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3162a6c0-61e4-5e8f-a289-1555aa552440 sending to next pipeline
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3162a6c0-61e4-5e8f-a289-1555aa552440, identifier: BD69274
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a8410>
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_c04102bf22b1284d431d1549d8c031e9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_c04102bf22b1284d431d1549d8c031e9.jpg saved to cache
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266f1450>
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff8%252F1ef82974a5dde50a763cc8b923f29a19%252Fpa%252FUP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg saved to cache
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca0d1ede-5762-5199-be14-0d1a264c6eac
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca0d1ede-5762-5199-be14-0d1a264c6eac, skipping ID generation
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca0d1ede-5762-5199-be14-0d1a264c6eac with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca0d1ede-5762-5199-be14-0d1a264c6eac sending to next pipeline
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca0d1ede-5762-5199-be14-0d1a264c6eac, identifier: UP09375
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d602850>
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fa9%252F6fa9b3c9cfa4c5208008abcda0badc85%252Fpa%252FFA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg saved to cache
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de3c38e9-2596-56db-a6c4-4f33a80c87a2
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de3c38e9-2596-56db-a6c4-4f33a80c87a2, skipping ID generation
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de3c38e9-2596-56db-a6c4-4f33a80c87a2 with scrape type 1
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de3c38e9-2596-56db-a6c4-4f33a80c87a2 sending to next pipeline
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de3c38e9-2596-56db-a6c4-4f33a80c87a2, identifier: FA09072
2026-03-28 11:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c3605d95-06a7-5934-9815-701b728fb2f9 with identifier: XF41535
2026-03-28 11:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c3605d95-06a7-5934-9815-701b728fb2f9 with identifier: XF41535
2026-03-28 11:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c3605d95-06a7-5934-9815-701b728fb2f9 with identifier: XF41535 to the API
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:33Z',
 'fuel_type': 'diesel',
 'id': 'c3605d95-06a7-5934-9815-701b728fb2f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF41535',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 175563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_9f81f69af389841911dae3ecd9bd086f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_f37bad68baea0d16816d6d976ee0d7f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_5df6ad095d9c2f7c19b1023916de94d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_b94b7e96f88bf2efdd8e80a80c31992b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_01359e8f83edf3162a9af1e7996d5ee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3605d95-06a7-5934-9815-701b728fb2f9/c3605d95-06a7-5934-9815-701b728fb2f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2d/2f2dcf5f2b627d0022f15c7e0a93eca5/pa/XF41535_fb00c988471a09344e80048a55c1e5bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 1.9 JTD M-Jet Distinctive',
 'transmission': 'manual',
 'trim': 'M-Jet Distinctive',
 'year': 2010}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF41535%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [auto1.es] INFO: Saving data for XF41535: {'created_time': 1774695677.084409, 'last_price_update_time': 1774695677.084419, 'auction_closing_time': 1774882833.0}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF41535') HTTP/1.1" 204 0
2026-03-28 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3162a6c0-61e4-5e8f-a289-1555aa552440 with identifier: BD69274
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3162a6c0-61e4-5e8f-a289-1555aa552440 with identifier: BD69274
2026-03-28 11:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3162a6c0-61e4-5e8f-a289-1555aa552440 with identifier: BD69274 to the API
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4a3053451834693bade795287951302b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:50Z',
 'fuel_type': 'diesel',
 'id': '3162a6c0-61e4-5e8f-a289-1555aa552440',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD69274',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 155719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_0af67076b6c929fa68c8254136f90bc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4a3053451834693bade795287951302b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_02f91193bacbe7a261e4fb8282e84813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9e6f73a9b6d879c1acc1581eb5636625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_9dee492d4365deca2ada489cf0508b5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_c20143bb53cf2b953638cff31a82272d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_14a19fd272ccdd6d3b056ef2ef929bb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_4d0e46a02bc81056ac559b433398f3f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_efc6bb93bb281d2a45f410c7717dc610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3162a6c0-61e4-5e8f-a289-1555aa552440/3162a6c0-61e4-5e8f-a289-1555aa552440_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/a9/09a903a7f59fdb94bb7ab38570b4a414/pa/BD69274_6b8c5fd3cb954be7b2199af61d161705.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2017}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD69274%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [auto1.es] INFO: Saving data for BD69274: {'created_time': 1774695677.701093, 'last_price_update_time': 1774695677.701103, 'auction_closing_time': 1774885670.0}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BD69274') HTTP/1.1" 204 0
2026-03-28 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca0d1ede-5762-5199-be14-0d1a264c6eac with identifier: UP09375
2026-03-28 11:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca0d1ede-5762-5199-be14-0d1a264c6eac with identifier: UP09375
2026-03-28 11:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca0d1ede-5762-5199-be14-0d1a264c6eac with identifier: UP09375 to the API
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:34:32Z',
 'fuel_type': 'diesel',
 'id': 'ca0d1ede-5762-5199-be14-0d1a264c6eac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP09375',
 'listing': 'auction',
 'location': 'ES, Tarragona',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 149882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_0ead9263f5adf906585396383e52108b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_f1e5a87082173cc5c87cf6579b0e2d7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_2dfdb8a0f05abb121bf3cb3cd840c025.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_ec178a99c9f6ff6750fbe634a218873b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_59385f326a14b9c922bbf187bb43ca5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca0d1ede-5762-5199-be14-0d1a264c6eac/ca0d1ede-5762-5199-be14-0d1a264c6eac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f8/1ef82974a5dde50a763cc8b923f29a19/pa/UP09375_5c5ce7293d5b3269c68848ad4211771a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Dynamique Luxe',
 'transmission': 'manual',
 'trim': 'Dynamique Luxe',
 'year': 2006}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP09375%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [auto1.es] INFO: Saving data for UP09375: {'created_time': 1774695678.092516, 'last_price_update_time': 1774695678.092527, 'auction_closing_time': 1774884872.0}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP09375') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de3c38e9-2596-56db-a6c4-4f33a80c87a2 with identifier: FA09072
2026-03-28 11:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de3c38e9-2596-56db-a6c4-4f33a80c87a2 with identifier: FA09072
2026-03-28 11:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de3c38e9-2596-56db-a6c4-4f33a80c87a2 with identifier: FA09072 to the API
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:17Z',
 'fuel_type': 'diesel',
 'id': 'de3c38e9-2596-56db-a6c4-4f33a80c87a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA09072',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 87836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_4840813ad9c9ed36114989c20d461636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_0939cd127e94cd21b54567f9f49600dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_e0941b4271bf62e087540e4d303e30d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d35baedac43c3d8d63e4e740351d77b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_9a5f52ea7bdc6dda7d037aeb66bf1ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_d98b52bb5082e2ae97f8ed2daa4a4b68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_c04102bf22b1284d431d1549d8c031e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_92c7f56bdb8dfba7d05d749fc67ff0ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_cc464766e39d844540211f65f142e91f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de3c38e9-2596-56db-a6c4-4f33a80c87a2/de3c38e9-2596-56db-a6c4-4f33a80c87a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/a9/6fa9b3c9cfa4c5208008abcda0badc85/pa/FA09072_04bdbc3cea57e8dea55318690abe734c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2017}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA09072%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [auto1.es] INFO: Saving data for FA09072: {'created_time': 1774695678.466378, 'last_price_update_time': 1774695678.466393, 'auction_closing_time': 1774884857.0}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA09072') HTTP/1.1" 204 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_09eb7402056770da89514c8ed8cc73d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_09eb7402056770da89514c8ed8cc73d2.jpg not downloaded yet
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg not downloaded yet
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_25d37acc42f380e5601fec861ff270e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_78fda99e6c68125db0919926912cfc73.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_1ecb419156d86ead39b85aa6cec85b21.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_b79d9c1e95032485349fc1f52eb45241.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_558b569c803ad97971797be595f46896.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF53027/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_ca103b14fc60e63372c4d4610db88dcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_ca103b14fc60e63372c4d4610db88dcf.jpg not downloaded yet
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_770cb4bfe40e46d1fa113f9525959544.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_770cb4bfe40e46d1fa113f9525959544.jpg not downloaded yet
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72747fc10>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726776d10>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_8dfe056ba22f11c51fc6870d341851fb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_8dfe056ba22f11c51fc6870d341851fb.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727150a50>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2cf2dd3-20a4-5b60-b944-1064f35b825b with identifier: GE22021
2026-03-28 11:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cf2dd3-20a4-5b60-b944-1064f35b825b with scrape type 1
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_d1e1d238f186def12385b8db107706e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d1e1d238f186def12385b8db107706e8.jpg not downloaded yet
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_0c198ab8590fed8432a8365d87a2fc71.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_0c198ab8590fed8432a8365d87a2fc71.jpg not downloaded yet
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_d06bf29c8fe465a44b8a89011b599816.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_d06bf29c8fe465a44b8a89011b599816.jpg not downloaded yet
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_174d21afcac371521da947e6a37dcd58.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_174d21afcac371521da947e6a37dcd58.jpg not downloaded yet
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_39f723434060a10b1635b68a043e2150.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_ae19f6dd36aaf5210be277eb3721af40.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726662650>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_25d37acc42f380e5601fec861ff270e9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_25d37acc42f380e5601fec861ff270e9.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271aa390>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72728a590>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_78fda99e6c68125db0919926912cfc73.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_78fda99e6c68125db0919926912cfc73.jpg saved to cache
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726552a90>
2026-03-28 11:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726565350>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726660d50>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_1ecb419156d86ead39b85aa6cec85b21.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_1ecb419156d86ead39b85aa6cec85b21.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727318910>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_b79d9c1e95032485349fc1f52eb45241.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_b79d9c1e95032485349fc1f52eb45241.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726534090>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_558b569c803ad97971797be595f46896.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_558b569c803ad97971797be595f46896.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:19 [auto1.es] INFO: Channel: 24h | Page: 12 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_27af8036ec9796b3eadf5bd34358cc29.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_27af8036ec9796b3eadf5bd34358cc29.jpg not downloaded yet
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg not downloaded yet
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg not downloaded yet
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_9636be85877456fb8af3fe0dcea23032.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_bb97c889125a83d53882a76daad023a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_918b1db31eadb77863d9b0faa561928d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_f7206a1b76ec127db20d624d0998b4c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: EW80297
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: YL07915
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: DD22164
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD22164%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for DD22164: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: GV40212
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV40212%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for GV40212: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: TV69131
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: AR64085
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR64085%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for AR64085: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: HS39015
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS39015%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for HS39015: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: UA50937
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA50937%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for UA50937: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: VF83817
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: VY65813
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY65813%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for VY65813: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: LS09862
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: WH92663
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH92663%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for WH92663: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: ZZ49032
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ49032%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for ZZ49032: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: FL34452
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL34452%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for FL34452: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: DS30814
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS30814%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for DS30814: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: WB36611
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB36611%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for WB36611: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: RY26799
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: FC07978
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC07978%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for FC07978: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: UB97521
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: KY65056
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: SJ54538
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ54538%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for SJ54538: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: BG90226
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: GZ75005
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ75005%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for GZ75005: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: BN23460
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: NW38370
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: AV31208
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: MR84623
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: BK60003
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK60003%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for BK60003: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: JP53710
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP53710%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for JP53710: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: LZ41727
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: ZK36200
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: LV38775
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: ZM37153
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: DJ31563
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ31563%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for DJ31563: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: KN17188
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: CD82527
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: EX33598
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX33598%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [auto1.es] INFO: Scrape type for EX33598: 0
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: MN90156
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: FN32638
2026-03-28 11:01:19 [auto1.es] INFO: Found listing with ID: ZR72253
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_83e9cfe0fbb509c8da130b972304533c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg not downloaded yet
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_0934c312503226ab7d9083ef584e2cb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_0934c312503226ab7d9083ef584e2cb6.jpg not downloaded yet
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_023296c6eb79d2dd59303571761f610e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_023296c6eb79d2dd59303571761f610e.jpg not downloaded yet
2026-03-28 11:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726581050>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_39f723434060a10b1635b68a043e2150.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_39f723434060a10b1635b68a043e2150.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271d53d0>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266240d0>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_ae19f6dd36aaf5210be277eb3721af40.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_ae19f6dd36aaf5210be277eb3721af40.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_3b655d69c313456d37f6871d6b4458ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_de592666df637fcb0e0e69a8536cbbf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_13eef874e532406186dadbc20ae127b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_13eef874e532406186dadbc20ae127b8.jpg not downloaded yet
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK87704/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726779890>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_9636be85877456fb8af3fe0dcea23032.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_9636be85877456fb8af3fe0dcea23032.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727475690>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_bb97c889125a83d53882a76daad023a0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_bb97c889125a83d53882a76daad023a0.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727474890>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_918b1db31eadb77863d9b0faa561928d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_918b1db31eadb77863d9b0faa561928d.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72db20150>
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_f7206a1b76ec127db20d624d0998b4c5.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_f7206a1b76ec127db20d624d0998b4c5.jpg saved to cache
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW90517/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg not downloaded yet
2026-03-28 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_09eb7402056770da89514c8ed8cc73d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d1e1d238f186def12385b8db107706e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273cef90>
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_83e9cfe0fbb509c8da130b972304533c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_83e9cfe0fbb509c8da130b972304533c.jpg saved to cache
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727111950>
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F80%252F7580ae41b0cb01ae9db0b098e3dbe073%252Fpa%252FMD68479_3b655d69c313456d37f6871d6b4458ed.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_3b655d69c313456d37f6871d6b4458ed.jpg saved to cache
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 061e6b20-34c6-585b-a203-e7dc88c0288b
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 061e6b20-34c6-585b-a203-e7dc88c0288b, skipping ID generation
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 061e6b20-34c6-585b-a203-e7dc88c0288b with scrape type 1
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 061e6b20-34c6-585b-a203-e7dc88c0288b sending to next pipeline
2026-03-28 11:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 061e6b20-34c6-585b-a203-e7dc88c0288b, identifier: MD68479
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274bb6d0>
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F32%252F2832ec2fd6f13812c2a1b5b4a314359b%252Fpa%252FWG45325_de592666df637fcb0e0e69a8536cbbf3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_de592666df637fcb0e0e69a8536cbbf3.jpg saved to cache
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5c6b348-59c0-5925-b929-7f342b0291d5
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5c6b348-59c0-5925-b929-7f342b0291d5, skipping ID generation
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5c6b348-59c0-5925-b929-7f342b0291d5 with scrape type 1
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5c6b348-59c0-5925-b929-7f342b0291d5 sending to next pipeline
2026-03-28 11:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e5c6b348-59c0-5925-b929-7f342b0291d5, identifier: WG45325
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727477bd0>
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fa1%252Fa6a17890ef5a104962103722ac607b38%252Fpa%252FRW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg saved to cache
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb416b38-171f-5043-a240-eb36764c8da4
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb416b38-171f-5043-a240-eb36764c8da4, skipping ID generation
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb416b38-171f-5043-a240-eb36764c8da4 with scrape type 1
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb416b38-171f-5043-a240-eb36764c8da4 sending to next pipeline
2026-03-28 11:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb416b38-171f-5043-a240-eb36764c8da4, identifier: RW31062
2026-03-28 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_ca103b14fc60e63372c4d4610db88dcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_e84b749f3186a801ffabd7063c30926b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_e84b749f3186a801ffabd7063c30926b.jpg not downloaded yet
2026-03-28 11:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 11:01:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479
2026-03-28 11:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 061e6b20-34c6-585b-a203-e7dc88c0288b with identifier: MD68479 to the API
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_3b655d69c313456d37f6871d6b4458ed.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:02:48Z',
 'fuel_type': 'hybrid',
 'id': '061e6b20-34c6-585b-a203-e7dc88c0288b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD68479',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 63212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_3b655d69c313456d37f6871d6b4458ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_ae19f6dd36aaf5210be277eb3721af40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_b79d9c1e95032485349fc1f52eb45241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_1ecb419156d86ead39b85aa6cec85b21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_8dfe056ba22f11c51fc6870d341851fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_5d810c370ea9ff4089108e099969739c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_0c70dbb19c9c10d9311388eb5ab3029e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_d5ceeb5faac03ea78ccdbb82e9c61cce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_eb2d1f72e144ebec2f7515cd952165e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_061e6b20-34c6-585b-a203-e7dc88c0288b/061e6b20-34c6-585b-a203-e7dc88c0288b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/80/7580ae41b0cb01ae9db0b098e3dbe073/pa/MD68479_c14b950fb527f715186f2b3c03cd09c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD68479%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [auto1.es] INFO: Saving data for MD68479: {'created_time': 1774695681.244992, 'last_price_update_time': 1774695681.24502, 'auction_closing_time': 1774882968.0}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MD68479') HTTP/1.1" 204 0
2026-03-28 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e5c6b348-59c0-5925-b929-7f342b0291d5 with identifier: WG45325
2026-03-28 11:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e5c6b348-59c0-5925-b929-7f342b0291d5 with identifier: WG45325
2026-03-28 11:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e5c6b348-59c0-5925-b929-7f342b0291d5 with identifier: WG45325 to the API
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_de592666df637fcb0e0e69a8536cbbf3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'diesel',
 'id': 'e5c6b348-59c0-5925-b929-7f342b0291d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG45325',
 'listing': 'auction',
 'location': 'ES, Cornellà de Llobregat',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 170787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_de592666df637fcb0e0e69a8536cbbf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_6ad046904a8f4447eda32c65d3fdffbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_25d37acc42f380e5601fec861ff270e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_78fda99e6c68125db0919926912cfc73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_990c41a1651ce00915938d82e9196e61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_50598b149306f7e6f24a0d6a9bc7767c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_075380a9aa40f5573da7a7ad54e12cea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_9adba6c0b6782eab20ca93738b51c587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_a237bde7e7f1a181f452cecdf082da18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5c6b348-59c0-5925-b929-7f342b0291d5/e5c6b348-59c0-5925-b929-7f342b0291d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/32/2832ec2fd6f13812c2a1b5b4a314359b/pa/WG45325_cab8178208d203b1e90d1b44dc43c727.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
 'transmission': 'manual',
 'trim': 'D LT 4WD',
 'year': 2010}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG45325%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [auto1.es] INFO: Saving data for WG45325: {'created_time': 1774695681.714837, 'last_price_update_time': 1774695681.714847, 'auction_closing_time': 1774884209.0}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG45325') HTTP/1.1" 204 0
2026-03-28 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb416b38-171f-5043-a240-eb36764c8da4 with identifier: RW31062
2026-03-28 11:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb416b38-171f-5043-a240-eb36764c8da4 with identifier: RW31062
2026-03-28 11:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb416b38-171f-5043-a240-eb36764c8da4 with identifier: RW31062 to the API
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'diesel',
 'id': 'eb416b38-171f-5043-a240-eb36764c8da4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW31062',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 93736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_8a2d0bf0f9c521b7f59e1f8a21fda765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_39f723434060a10b1635b68a043e2150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_96b8786f92965322b01d47444446c846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_984e3db2599ff1c49bffdc7f15b9b110.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_88450a79c233cbc8283a75187b2cacd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_b69ab7b19e35509693b01a6a32102f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_41df1fb15e85312b5ac404f256df1db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_59746674f55042897bf272d659ba8c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_e046f4fd04e09c66603b6ead79ac4d93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb416b38-171f-5043-a240-eb36764c8da4/eb416b38-171f-5043-a240-eb36764c8da4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/a1/a6a17890ef5a104962103722ac607b38/pa/RW31062_0021c49bd5548428e6d890c5676678fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Altea 2.0 TDI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2008}
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW31062%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [auto1.es] INFO: Saving data for RW31062: {'created_time': 1774695682.068247, 'last_price_update_time': 1774695682.068258, 'auction_closing_time': 1774883720.0}
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RW31062') HTTP/1.1" 204 0
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_770cb4bfe40e46d1fa113f9525959544.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_27af8036ec9796b3eadf5bd34358cc29.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_023296c6eb79d2dd59303571761f610e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg not downloaded yet
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY52892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726523e90>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_09eb7402056770da89514c8ed8cc73d2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_09eb7402056770da89514c8ed8cc73d2.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72720c050>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_d1e1d238f186def12385b8db107706e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d1e1d238f186def12385b8db107706e8.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72678f750>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_0934c312503226ab7d9083ef584e2cb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_122b1ea467b7e47e4d14212daea07247.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_122b1ea467b7e47e4d14212daea07247.jpg not downloaded yet
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727125290>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_ca103b14fc60e63372c4d4610db88dcf.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_ca103b14fc60e63372c4d4610db88dcf.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_d06bf29c8fe465a44b8a89011b599816.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_0c198ab8590fed8432a8365d87a2fc71.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_d0e963252f8638a42a3e068953648315.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d0e963252f8638a42a3e068953648315.jpg not downloaded yet
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_288275355b4cc0b12f0c03924dc899fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_13eef874e532406186dadbc20ae127b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_174d21afcac371521da947e6a37dcd58.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72679aa90>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_770cb4bfe40e46d1fa113f9525959544.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_770cb4bfe40e46d1fa113f9525959544.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273b3490>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726553210>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_27af8036ec9796b3eadf5bd34358cc29.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_27af8036ec9796b3eadf5bd34358cc29.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271258d0>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_023296c6eb79d2dd59303571761f610e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_023296c6eb79d2dd59303571761f610e.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72677b450>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273b1110>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726674850>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_0934c312503226ab7d9083ef584e2cb6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_0934c312503226ab7d9083ef584e2cb6.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_e84b749f3186a801ffabd7063c30926b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726675dd0>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fc1%252F5ac1c6e35982a742bac29f4fbae64f44%252Fpa%252FXA25667_d06bf29c8fe465a44b8a89011b599816.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_d06bf29c8fe465a44b8a89011b599816.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cf64777-3c4e-5195-8417-fc60cc76abab
2026-03-28 11:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cf64777-3c4e-5195-8417-fc60cc76abab, skipping ID generation
2026-03-28 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cf64777-3c4e-5195-8417-fc60cc76abab with scrape type 1
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cf64777-3c4e-5195-8417-fc60cc76abab sending to next pipeline
2026-03-28 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1cf64777-3c4e-5195-8417-fc60cc76abab, identifier: XA25667
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72db206d0>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fbe%252F5fbe8717d83267d4af253bc7e35a509b%252Fpa%252FNX17648_0c198ab8590fed8432a8365d87a2fc71.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_0c198ab8590fed8432a8365d87a2fc71.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a
2026-03-28 11:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a, skipping ID generation
2026-03-28 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with scrape type 1
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a sending to next pipeline
2026-03-28 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a, identifier: NX17648
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270100d0>
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdf%252F07df5e1b6c2abe8a9c95bb241102c6a7%252Fpa%252FXP60269_288275355b4cc0b12f0c03924dc899fc.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_288275355b4cc0b12f0c03924dc899fc.jpg saved to cache
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e71a9d57-b693-5013-b9bf-84c7fe54476c
2026-03-28 11:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e71a9d57-b693-5013-b9bf-84c7fe54476c, skipping ID generation
2026-03-28 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e71a9d57-b693-5013-b9bf-84c7fe54476c with scrape type 1
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e71a9d57-b693-5013-b9bf-84c7fe54476c sending to next pipeline
2026-03-28 11:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e71a9d57-b693-5013-b9bf-84c7fe54476c, identifier: XP60269
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271db790>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_13eef874e532406186dadbc20ae127b8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_13eef874e532406186dadbc20ae127b8.jpg saved to cache
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727012b10>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_174d21afcac371521da947e6a37dcd58.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_174d21afcac371521da947e6a37dcd58.jpg saved to cache
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_122b1ea467b7e47e4d14212daea07247.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1cf64777-3c4e-5195-8417-fc60cc76abab with identifier: XA25667
2026-03-28 11:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1cf64777-3c4e-5195-8417-fc60cc76abab with identifier: XA25667
2026-03-28 11:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1cf64777-3c4e-5195-8417-fc60cc76abab with identifier: XA25667 to the API
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_d06bf29c8fe465a44b8a89011b599816.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'petrol',
 'id': '1cf64777-3c4e-5195-8417-fc60cc76abab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA25667',
 'listing': 'auction',
 'location': 'ES, Elche',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 176755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_f7206a1b76ec127db20d624d0998b4c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_b5965703028bb6733ecd240ed4f5a1cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_770cb4bfe40e46d1fa113f9525959544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_d06bf29c8fe465a44b8a89011b599816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_5773b911baf91c8cf3969bb486cbc1c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cf64777-3c4e-5195-8417-fc60cc76abab/1cf64777-3c4e-5195-8417-fc60cc76abab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c6e35982a742bac29f4fbae64f44/pa/XA25667_0934c312503226ab7d9083ef584e2cb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA25667%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [auto1.es] INFO: Saving data for XA25667: {'created_time': 1774695683.504272, 'last_price_update_time': 1774695683.504284, 'auction_closing_time': 1774882804.0}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XA25667') HTTP/1.1" 204 0
2026-03-28 11:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with identifier: NX17648
2026-03-28 11:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with identifier: NX17648
2026-03-28 11:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ad15bb0-c544-5e98-abb3-34b60fb9fa4a with identifier: NX17648 to the API
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_0c198ab8590fed8432a8365d87a2fc71.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:53:18Z',
 'fuel_type': 'diesel',
 'id': '7ad15bb0-c544-5e98-abb3-34b60fb9fa4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX17648',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 372739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_918b1db31eadb77863d9b0faa561928d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_09eb7402056770da89514c8ed8cc73d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_ca103b14fc60e63372c4d4610db88dcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_0c198ab8590fed8432a8365d87a2fc71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_27af8036ec9796b3eadf5bd34358cc29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ad15bb0-c544-5e98-abb3-34b60fb9fa4a/7ad15bb0-c544-5e98-abb3-34b60fb9fa4a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/be/5fbe8717d83267d4af253bc7e35a509b/pa/NX17648_6f2ca2b338d35610d9b39b730ceb4ecb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna Premium 4x4',
 'transmission': 'manual',
 'trim': 'Tekna Premium 4x4',
 'year': 2012}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX17648%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [auto1.es] INFO: Saving data for NX17648: {'created_time': 1774695683.876914, 'last_price_update_time': 1774695683.876925, 'auction_closing_time': 1774885998.0}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NX17648') HTTP/1.1" 204 0
2026-03-28 11:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e71a9d57-b693-5013-b9bf-84c7fe54476c with identifier: XP60269
2026-03-28 11:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e71a9d57-b693-5013-b9bf-84c7fe54476c with identifier: XP60269
2026-03-28 11:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e71a9d57-b693-5013-b9bf-84c7fe54476c with identifier: XP60269 to the API
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_288275355b4cc0b12f0c03924dc899fc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:29:11Z',
 'fuel_type': 'petrol',
 'id': 'e71a9d57-b693-5013-b9bf-84c7fe54476c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP60269',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 203603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_288275355b4cc0b12f0c03924dc899fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_bb97c889125a83d53882a76daad023a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a55020a8c801bba5adc1d718ec5cf12f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_558b569c803ad97971797be595f46896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_47d731ee9b43f058a74617ca6f21fa8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_1ddb6ca46ac87a21515c9f3f3c62ea81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_51b2382b0f4551a5bd40c548dc66ff3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_55c950feb062fdac19e98521965067a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_a0c67d8b32b107cc371ad44735e3da1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e71a9d57-b693-5013-b9bf-84c7fe54476c/e71a9d57-b693-5013-b9bf-84c7fe54476c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/df/07df5e1b6c2abe8a9c95bb241102c6a7/pa/XP60269_490cc8d7925f707a128eaaad76ba8660.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza Reference Plus Reference Plus',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP60269%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [auto1.es] INFO: Saving data for XP60269: {'created_time': 1774695684.258503, 'last_price_update_time': 1774695684.258514, 'auction_closing_time': 1774884551.0}
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP60269') HTTP/1.1" 204 0
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d0e963252f8638a42a3e068953648315.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK54179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK87704> (referer: https://www.auto1.com/v1/car-details-view/KK87704/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU20773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267cc850>
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fa2%252Fe9a235d37d2dee47b52a6cd075a82c8f%252Fpa%252FLJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg saved to cache
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 959ca873-f14c-5456-8a6b-12a6945617da
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 959ca873-f14c-5456-8a6b-12a6945617da, skipping ID generation
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959ca873-f14c-5456-8a6b-12a6945617da with scrape type 1
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 959ca873-f14c-5456-8a6b-12a6945617da sending to next pipeline
2026-03-28 11:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 959ca873-f14c-5456-8a6b-12a6945617da, identifier: LJ63273
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270296d0>
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg saved to cache
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d5fcbd0>
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg saved to cache
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72719e890>
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_e84b749f3186a801ffabd7063c30926b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_e84b749f3186a801ffabd7063c30926b.jpg saved to cache
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF53027> (referer: https://www.auto1.com/v1/car-details-view/AF53027/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 959ca873-f14c-5456-8a6b-12a6945617da with identifier: LJ63273
2026-03-28 11:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 959ca873-f14c-5456-8a6b-12a6945617da with identifier: LJ63273
2026-03-28 11:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 959ca873-f14c-5456-8a6b-12a6945617da with identifier: LJ63273 to the API
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:01:40Z',
 'fuel_type': 'petrol',
 'id': '959ca873-f14c-5456-8a6b-12a6945617da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ63273',
 'listing': 'auction',
 'location': 'ES, El Vendrell',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 133039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7252266d55e9e8c35e596b4a9f3b3286.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_83e9cfe0fbb509c8da130b972304533c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_9636be85877456fb8af3fe0dcea23032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_7474b723de01e630fd1c66c82b3a8c29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_0a42efdfa3db0ac1714eeaf92696e9fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959ca873-f14c-5456-8a6b-12a6945617da/959ca873-f14c-5456-8a6b-12a6945617da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/a2/e9a235d37d2dee47b52a6cd075a82c8f/pa/LJ63273_6aec8f5abbe4a964a4ae93eb182911c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-07-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2007}
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ63273%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Saving data for LJ63273: {'created_time': 1774695685.07391, 'last_price_update_time': 1774695685.073922, 'auction_closing_time': 1774882900.0}
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ63273') HTTP/1.1" 204 0
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727278250>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_122b1ea467b7e47e4d14212daea07247.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_122b1ea467b7e47e4d14212daea07247.jpg saved to cache
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH51643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV66475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d370c50>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F1e%252F6e1e775b8e8f0ae3be471a5a4dfc294c%252Fpa%252FGE22021_d0e963252f8638a42a3e068953648315.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d0e963252f8638a42a3e068953648315.jpg saved to cache
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2cf2dd3-20a4-5b60-b944-1064f35b825b
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2cf2dd3-20a4-5b60-b944-1064f35b825b, skipping ID generation
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cf2dd3-20a4-5b60-b944-1064f35b825b with scrape type 1
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2cf2dd3-20a4-5b60-b944-1064f35b825b sending to next pipeline
2026-03-28 11:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2cf2dd3-20a4-5b60-b944-1064f35b825b, identifier: GE22021
2026-03-28 11:01:25 [auto1.es] INFO: Channel: 24h | Page: 13 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87434cdc-b939-5117-a4ca-a2dbd47c2823 with identifier: KK87704
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87434cdc-b939-5117-a4ca-a2dbd47c2823 with scrape type 1
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg not downloaded yet
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01fcc95-ccef-5a4a-86b4-02883430b181 with identifier: AF53027
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01fcc95-ccef-5a4a-86b4-02883430b181 with scrape type 1
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_793c0c73a36d137435610b5902618c6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_793c0c73a36d137435610b5902618c6b.jpg not downloaded yet
2026-03-28 11:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2cf2dd3-20a4-5b60-b944-1064f35b825b with identifier: GE22021
2026-03-28 11:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2cf2dd3-20a4-5b60-b944-1064f35b825b with identifier: GE22021
2026-03-28 11:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2cf2dd3-20a4-5b60-b944-1064f35b825b with identifier: GE22021 to the API
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d0e963252f8638a42a3e068953648315.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:52Z',
 'fuel_type': 'diesel',
 'id': 'd2cf2dd3-20a4-5b60-b944-1064f35b825b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE22021',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 211859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d1e1d238f186def12385b8db107706e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_174d21afcac371521da947e6a37dcd58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_b804daed8e60a2ed60fdde86af0e03e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_023296c6eb79d2dd59303571761f610e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_13eef874e532406186dadbc20ae127b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_9f7a9fc29edcb009f364143ce5fa3b58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_e84b749f3186a801ffabd7063c30926b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_8d95cdc2bd5d60909b09a19e3cca9765.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_122b1ea467b7e47e4d14212daea07247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2cf2dd3-20a4-5b60-b944-1064f35b825b/d2cf2dd3-20a4-5b60-b944-1064f35b825b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/1e/6e1e775b8e8f0ae3be471a5a4dfc294c/pa/GE22021_d0e963252f8638a42a3e068953648315.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Kaiteki 4WD',
 'transmission': 'automatic',
 'trim': 'Kaiteki 4WD',
 'year': 2015}
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE22021%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Saving data for GE22021: {'created_time': 1774695685.754906, 'last_price_update_time': 1774695685.754917, 'auction_closing_time': 1774884652.0}
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE22021') HTTP/1.1" 204 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: ZD67493
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD67493%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for ZD67493: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: AS98814
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: BK97783
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK97783%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for BK97783: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: KK12600
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: JG89903
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: PK49923
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK49923%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for PK49923: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: LM83979
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: GK87335
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: HV65502
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: EM52584
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM52584%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for EM52584: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: WV15930
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV15930%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for WV15930: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: RJ73355
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ73355%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for RJ73355: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: MX84470
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX84470%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for MX84470: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: JL97970
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: ZM34932
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: TR33339
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: WJ21268
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ21268%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for WJ21268: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: HC75906
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC75906%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for HC75906: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: FW26627
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: WZ74914
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: BY70112
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY70112%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for BY70112: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: TV99660
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV99660%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for TV99660: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: UF76170
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: GU11117
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: XE21936
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: XS40822
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: AN90905
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: AF12628
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF12628%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for AF12628: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: RE01246
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: SP11103
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: ME86804
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: WC91216
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: DL38940
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL38940%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [auto1.es] INFO: Scrape type for DL38940: 0
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: EE29510
2026-03-28 11:01:25 [auto1.es] INFO: Found listing with ID: ED08036
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED08036%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.es] INFO: Scrape type for ED08036: 0
2026-03-28 11:01:26 [auto1.es] INFO: Found listing with ID: SZ63462
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ63462%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.es] INFO: Scrape type for SZ63462: 0
2026-03-28 11:01:26 [auto1.es] INFO: Found listing with ID: RU33051
2026-03-28 11:01:26 [auto1.es] INFO: Found listing with ID: VL31670
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL31670%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.es] INFO: Scrape type for VL31670: 0
2026-03-28 11:01:26 [auto1.es] INFO: Found listing with ID: LL79483
2026-03-28 11:01:26 [auto1.es] INFO: Found listing with ID: UX89995
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_08fb6ff460f7a913e5e776a341de230e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_08fb6ff460f7a913e5e776a341de230e.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_1e77cceb227dd73a6735818e23f8e840.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_1e77cceb227dd73a6735818e23f8e840.jpg not downloaded yet
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW90517> (referer: https://www.auto1.com/v1/car-details-view/RW90517/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_4087cb16c41557b88a4df928361c81d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4087cb16c41557b88a4df928361c81d0.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_234b52252a916a4a2e9cef7abee62570.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_234b52252a916a4a2e9cef7abee62570.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_3ea5c949963e01c499c75f16907f9e86.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3ea5c949963e01c499c75f16907f9e86.jpg not downloaded yet
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_763e1f51fa2eaac371db483f71843455.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_763e1f51fa2eaac371db483f71843455.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_83f18279ebd200978786d24cdbfd7a84.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_83f18279ebd200978786d24cdbfd7a84.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_793c0c73a36d137435610b5902618c6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_457f75fab62ab0588808b73a05a5e433.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_457f75fab62ab0588808b73a05a5e433.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_3de1e3b208bffc731282ff551e586270.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3de1e3b208bffc731282ff551e586270.jpg not downloaded yet
2026-03-28 11:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f2a49da-9752-5512-bc07-89a2558e7f4c with identifier: RW90517
2026-03-28 11:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2a49da-9752-5512-bc07-89a2558e7f4c with scrape type 1
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_51e297b086e65241e37b3db83982e502.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_51e297b086e65241e37b3db83982e502.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_1e77cceb227dd73a6735818e23f8e840.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_7821573123a35af61377a538fcf404f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_7821573123a35af61377a538fcf404f8.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_8ea112d414970ea0c64aa9e163571dfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_8ea112d414970ea0c64aa9e163571dfa.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3ea5c949963e01c499c75f16907f9e86.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg not downloaded yet
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726734c90>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b3290>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_793c0c73a36d137435610b5902618c6b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_793c0c73a36d137435610b5902618c6b.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_08fb6ff460f7a913e5e776a341de230e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_51e297b086e65241e37b3db83982e502.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4087cb16c41557b88a4df928361c81d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_234b52252a916a4a2e9cef7abee62570.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_763e1f51fa2eaac371db483f71843455.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_83f18279ebd200978786d24cdbfd7a84.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726530990>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_1e77cceb227dd73a6735818e23f8e840.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_1e77cceb227dd73a6735818e23f8e840.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270beb10>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_3ea5c949963e01c499c75f16907f9e86.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3ea5c949963e01c499c75f16907f9e86.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_54a4092263848d7f3200673862e9ed57.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_54a4092263848d7f3200673862e9ed57.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_8ea112d414970ea0c64aa9e163571dfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg not downloaded yet
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72726b190>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_08fb6ff460f7a913e5e776a341de230e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_08fb6ff460f7a913e5e776a341de230e.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726553d90>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e3b10>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_51e297b086e65241e37b3db83982e502.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_51e297b086e65241e37b3db83982e502.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e31d0>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_4087cb16c41557b88a4df928361c81d0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4087cb16c41557b88a4df928361c81d0.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_78509fd7593f60fbf87549e606b904d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_78509fd7593f60fbf87549e606b904d1.jpg not downloaded yet
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_7821573123a35af61377a538fcf404f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ22884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV48329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727032810>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_234b52252a916a4a2e9cef7abee62570.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_234b52252a916a4a2e9cef7abee62570.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72653b9d0>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_763e1f51fa2eaac371db483f71843455.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_763e1f51fa2eaac371db483f71843455.jpg saved to cache
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727494850>
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_83f18279ebd200978786d24cdbfd7a84.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_83f18279ebd200978786d24cdbfd7a84.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b2d50>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_8ea112d414970ea0c64aa9e163571dfa.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_8ea112d414970ea0c64aa9e163571dfa.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3de1e3b208bffc731282ff551e586270.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_f268fcc1dcb4755e33b999f645fb1562.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_f268fcc1dcb4755e33b999f645fb1562.jpg not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg not downloaded yet
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274df150>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271cc6d0>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267eb850>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_7821573123a35af61377a538fcf404f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_7821573123a35af61377a538fcf404f8.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72728bed0>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727149d50>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_54a4092263848d7f3200673862e9ed57.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_457f75fab62ab0588808b73a05a5e433.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_78509fd7593f60fbf87549e606b904d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY52892> (referer: https://www.auto1.com/v1/car-details-view/CY52892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH51643> (referer: https://www.auto1.com/v1/car-details-view/KH51643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72734f150>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726652550>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252F2e%252Fa12e80882cf2c0007f7f6f23d7ff74b9%252Fpa%252FAF53027_3de1e3b208bffc731282ff551e586270.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3de1e3b208bffc731282ff551e586270.jpg saved to cache
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b01fcc95-ccef-5a4a-86b4-02883430b181
2026-03-28 11:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b01fcc95-ccef-5a4a-86b4-02883430b181, skipping ID generation
2026-03-28 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01fcc95-ccef-5a4a-86b4-02883430b181 with scrape type 1
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b01fcc95-ccef-5a4a-86b4-02883430b181 sending to next pipeline
2026-03-28 11:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b01fcc95-ccef-5a4a-86b4-02883430b181, identifier: AF53027
2026-03-28 11:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b01fcc95-ccef-5a4a-86b4-02883430b181 with identifier: AF53027
2026-03-28 11:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b01fcc95-ccef-5a4a-86b4-02883430b181 with identifier: AF53027
2026-03-28 11:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b01fcc95-ccef-5a4a-86b4-02883430b181 with identifier: AF53027 to the API
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3de1e3b208bffc731282ff551e586270.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:29:25Z',
 'fuel_type': 'petrol',
 'id': 'b01fcc95-ccef-5a4a-86b4-02883430b181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF53027',
 'listing': 'auction',
 'location': 'ES, Pamplona',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 204644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_793c0c73a36d137435610b5902618c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_1e77cceb227dd73a6735818e23f8e840.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_6cf8b3bdaa70fc07c9a414c5e73e683a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3ea5c949963e01c499c75f16907f9e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_83f18279ebd200978786d24cdbfd7a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b01fcc95-ccef-5a4a-86b4-02883430b181/b01fcc95-ccef-5a4a-86b4-02883430b181_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/2e/a12e80882cf2c0007f7f6f23d7ff74b9/pa/AF53027_3de1e3b208bffc731282ff551e586270.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF53027%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [auto1.es] INFO: Saving data for AF53027: {'created_time': 1774695688.138759, 'last_price_update_time': 1774695688.138772, 'auction_closing_time': 1774884565.0}
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AF53027') HTTP/1.1" 204 0
2026-03-28 11:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_f268fcc1dcb4755e33b999f645fb1562.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV66475> (referer: https://www.auto1.com/v1/car-details-view/CV66475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK54179> (referer: https://www.auto1.com/v1/car-details-view/ZK54179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU20773> (referer: https://www.auto1.com/v1/car-details-view/RU20773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727342d90>
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_54a4092263848d7f3200673862e9ed57.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_54a4092263848d7f3200673862e9ed57.jpg saved to cache
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727108150>
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg saved to cache
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727343c90>
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg saved to cache
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727011550>
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252F91%252F5f91cc3c7e0231d9f87e62b087f4798d%252Fpa%252FKK87704_457f75fab62ab0588808b73a05a5e433.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_457f75fab62ab0588808b73a05a5e433.jpg saved to cache
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87434cdc-b939-5117-a4ca-a2dbd47c2823
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87434cdc-b939-5117-a4ca-a2dbd47c2823, skipping ID generation
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87434cdc-b939-5117-a4ca-a2dbd47c2823 with scrape type 1
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87434cdc-b939-5117-a4ca-a2dbd47c2823 sending to next pipeline
2026-03-28 11:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87434cdc-b939-5117-a4ca-a2dbd47c2823, identifier: KK87704
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273e8b10>
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_78509fd7593f60fbf87549e606b904d1.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_78509fd7593f60fbf87549e606b904d1.jpg saved to cache
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 519cdc8d-82e4-5c66-b350-a68130b19e3c with identifier: CY52892
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519cdc8d-82e4-5c66-b350-a68130b19e3c with scrape type 1
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_db82c89592746aa171a6d91f2c091e7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_db82c89592746aa171a6d91f2c091e7a.jpg not downloaded yet
2026-03-28 11:01:28 [auto1.es] INFO: Channel: 24h | Page: 14 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with identifier: KH51643
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with scrape type 1
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_c2df646594125ec1c543ffee4193944b.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_c2df646594125ec1c543ffee4193944b.jpg not downloaded yet
2026-03-28 11:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87434cdc-b939-5117-a4ca-a2dbd47c2823 with identifier: KK87704
2026-03-28 11:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87434cdc-b939-5117-a4ca-a2dbd47c2823 with identifier: KK87704
2026-03-28 11:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87434cdc-b939-5117-a4ca-a2dbd47c2823 with identifier: KK87704 to the API
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_457f75fab62ab0588808b73a05a5e433.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:49Z',
 'fuel_type': 'diesel',
 'id': '87434cdc-b939-5117-a4ca-a2dbd47c2823',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK87704',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_32b94d10e8af07453dbcf8ae5d345ffb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_08fb6ff460f7a913e5e776a341de230e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4087cb16c41557b88a4df928361c81d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_234b52252a916a4a2e9cef7abee62570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_763e1f51fa2eaac371db483f71843455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_457f75fab62ab0588808b73a05a5e433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_c2d9dc97ae276d0f1cdeb2044bef1190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_4e8d515180adbb9ed78c122d05c31a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_2719e8e38b1d1a110542e6dc1bf793de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87434cdc-b939-5117-a4ca-a2dbd47c2823/87434cdc-b939-5117-a4ca-a2dbd47c2823_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5f/91/5f91cc3c7e0231d9f87e62b087f4798d/pa/KK87704_75e6ad5d89e3e5266ca4573b87ba8c3b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2014}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK87704%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Saving data for KK87704: {'created_time': 1774695689.056684, 'last_price_update_time': 1774695689.056694, 'auction_closing_time': 1774885909.0}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KK87704') HTTP/1.1" 204 0
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg not downloaded yet
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: KB87901
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB87901%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for KB87901: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: WB10025
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: AK86639
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: UB42787
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB42787%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for UB42787: 2
2026-03-28 11:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with identifier: UB42787
2026-03-28 11:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with scrape type 2
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with scrape type 2
2026-03-28 11:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb1206ed-a162-56ee-ab4d-ff727c1e8c21, identifier: UB42787
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_19a889f7a0dd4f37801cbdff0486e617.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_19a889f7a0dd4f37801cbdff0486e617.jpg not downloaded yet
2026-03-28 11:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with identifier: UB42787
2026-03-28 11:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with identifier: UB42787
2026-03-28 11:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb1206ed-a162-56ee-ab4d-ff727c1e8c21 with identifier: UB42787 to the API
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:21:52Z',
 'fuel_type': 'diesel',
 'id': 'eb1206ed-a162-56ee-ab4d-ff727c1e8c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB42787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 136816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB42787%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Saving data for UB42787: {'auction_closing_time': 1774714912.0, 'created_time': 1774512025.704216, 'last_price_update_time': 1774695689.699328}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB42787') HTTP/1.1" 204 0
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_c94822e2fc202b031525b45cdf3fddbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_c94822e2fc202b031525b45cdf3fddbf.jpg not downloaded yet
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: MB13391
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB13391%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for MB13391: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: YU77194
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: TU71868
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: XT49013
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: TX70336
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX70336%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for TX70336: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: KD45513
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: YD06518
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD06518%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for YD06518: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: UT62475
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: VJ40184
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: JF96117
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF96117%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for JF96117: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: VF82701
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: PE23246
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE23246%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for PE23246: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: DR94392
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR94392%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for DR94392: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: FP05442
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP05442%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for FP05442: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: HC55702
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: HP42544
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HP42544%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for HP42544: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: SR16333
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: XL86918
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: YB76254
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB76254%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for YB76254: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: LH51054
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH51054%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for LH51054: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: TZ65854
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: GT68357
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT68357%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for GT68357: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: XJ12820
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: WZ30869
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ30869%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for WZ30869: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: XZ41303
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: MG78931
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: HW09758
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: AU55314
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: LF34869
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: ZD98631
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98631%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for ZD98631: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: CX01476
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX01476%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for CX01476: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: YW16377
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: LK93242
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: WH79460
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79460%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [auto1.es] INFO: Scrape type for WH79460: 0
2026-03-28 11:01:29 [auto1.es] INFO: Found listing with ID: BP77567
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP77567%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [auto1.es] INFO: Scrape type for BP77567: 0
2026-03-28 11:01:30 [auto1.es] INFO: Found listing with ID: HF28057
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF28057%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [auto1.es] INFO: Scrape type for HF28057: 0
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_ff48638a394f73c87a64c216a8d380b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_ff48638a394f73c87a64c216a8d380b6.jpg not downloaded yet
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710bc90>
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_f268fcc1dcb4755e33b999f645fb1562.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_f268fcc1dcb4755e33b999f645fb1562.jpg saved to cache
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18bfee5-1c90-5131-8cd3-6e60271c5f77 with identifier: CV66475
2026-03-28 11:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18bfee5-1c90-5131-8cd3-6e60271c5f77 with scrape type 1
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_7237de7614e94e82350ac1be2d9cfa28.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_7237de7614e94e82350ac1be2d9cfa28.jpg not downloaded yet
2026-03-28 11:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with identifier: ZK54179
2026-03-28 11:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with scrape type 1
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg not downloaded yet
2026-03-28 11:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753fe24e-17d6-5c03-9437-20017b0c39f0 with identifier: RU20773
2026-03-28 11:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753fe24e-17d6-5c03-9437-20017b0c39f0 with scrape type 1
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_27d4729e67365e775cc514f6d81ef6b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_27d4729e67365e775cc514f6d81ef6b3.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_1754d3c785b30da32b18146eba3d3634.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_1754d3c785b30da32b18146eba3d3634.jpg not downloaded yet
2026-03-28 11:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_db82c89592746aa171a6d91f2c091e7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_c2df646594125ec1c543ffee4193944b.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_e94abeaa132a52382e66e11f82cca427.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_e94abeaa132a52382e66e11f82cca427.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_0580d9bc5453d56113d4a6921244b287.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_0580d9bc5453d56113d4a6921244b287.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_941556fae871003db631591e60ad8cbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_941556fae871003db631591e60ad8cbe.jpg not downloaded yet
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726652d10>
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F23%252F0523bc5af39f962c49155fa94eb9f50b%252Fpa%252FRW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg saved to cache
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f2a49da-9752-5512-bc07-89a2558e7f4c
2026-03-28 11:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f2a49da-9752-5512-bc07-89a2558e7f4c, skipping ID generation
2026-03-28 11:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2a49da-9752-5512-bc07-89a2558e7f4c with scrape type 1
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f2a49da-9752-5512-bc07-89a2558e7f4c sending to next pipeline
2026-03-28 11:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f2a49da-9752-5512-bc07-89a2558e7f4c, identifier: RW90517
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_6d4065b35b99824411e875cd7c924a23.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_6d4065b35b99824411e875cd7c924a23.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_8009c915cc9cc816f20a34c801e87e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_8009c915cc9cc816f20a34c801e87e22.jpg not downloaded yet
2026-03-28 11:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f2a49da-9752-5512-bc07-89a2558e7f4c with identifier: RW90517
2026-03-28 11:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f2a49da-9752-5512-bc07-89a2558e7f4c with identifier: RW90517
2026-03-28 11:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f2a49da-9752-5512-bc07-89a2558e7f4c with identifier: RW90517 to the API
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'petrol',
 'id': '9f2a49da-9752-5512-bc07-89a2558e7f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW90517',
 'listing': 'auction',
 'location': 'ES, Puerto de Santa María',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 84120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_51e297b086e65241e37b3db83982e502.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_7821573123a35af61377a538fcf404f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_8ea112d414970ea0c64aa9e163571dfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_2940f56bb9cdcf05d34535ebe9484fb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_b4bcb3339f92b1f038234fb4b72c17f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_54a4092263848d7f3200673862e9ed57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_c3d214e477ee2bbbc788a17ee9bafa61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_78509fd7593f60fbf87549e606b904d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_f268fcc1dcb4755e33b999f645fb1562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f2a49da-9752-5512-bc07-89a2558e7f4c/9f2a49da-9752-5512-bc07-89a2558e7f4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img05/23/0523bc5af39f962c49155fa94eb9f50b/pa/RW90517_ef47ebf1c198f07a15ab736aabed4fe9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW90517%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [auto1.es] INFO: Saving data for RW90517: {'created_time': 1774695690.793171, 'last_price_update_time': 1774695690.793184, 'auction_closing_time': 1774885456.0}
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RW90517') HTTP/1.1" 204 0
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_1de3730cfd7184350bb0f2785508aace.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_1de3730cfd7184350bb0f2785508aace.jpg not downloaded yet
2026-03-28 11:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_19a889f7a0dd4f37801cbdff0486e617.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_4d048cb2415df71f8a26be0192763df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_4d048cb2415df71f8a26be0192763df1.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg not downloaded yet
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727095c50>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_db82c89592746aa171a6d91f2c091e7a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_db82c89592746aa171a6d91f2c091e7a.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72671ddd0>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_c2df646594125ec1c543ffee4193944b.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_c2df646594125ec1c543ffee4193944b.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_ff48638a394f73c87a64c216a8d380b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_c94822e2fc202b031525b45cdf3fddbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_dd1fe3a6839419a126af838257e6f4b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_dd1fe3a6839419a126af838257e6f4b5.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_8705dcd5d4feded63cec0f67816040e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_8705dcd5d4feded63cec0f67816040e8.jpg not downloaded yet
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV48329> (referer: https://www.auto1.com/v1/car-details-view/VV48329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ22884> (referer: https://www.auto1.com/v1/car-details-view/YJ22884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_7237de7614e94e82350ac1be2d9cfa28.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_959c12657c8009797babda8fd877a98c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_959c12657c8009797babda8fd877a98c.jpg not downloaded yet
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_2875a2737e97383dce067ace8549eea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_2875a2737e97383dce067ace8549eea9.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg not downloaded yet
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_1754d3c785b30da32b18146eba3d3634.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_941556fae871003db631591e60ad8cbe.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_87742b2df457b5a2554ad06f0ab4a587.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_87742b2df457b5a2554ad06f0ab4a587.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_a19032a144ee3ee09bb304a728c5bad2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_a19032a144ee3ee09bb304a728c5bad2.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_7f753340516ea9e0558da2d6eb771850.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7f753340516ea9e0558da2d6eb771850.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_df74b78507a618f23785cffaa38a1be0.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_df74b78507a618f23785cffaa38a1be0.jpg not downloaded yet
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271382d0>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_19a889f7a0dd4f37801cbdff0486e617.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_19a889f7a0dd4f37801cbdff0486e617.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72661f710>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_0580d9bc5453d56113d4a6921244b287.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg not downloaded yet
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_27d4729e67365e775cc514f6d81ef6b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg not downloaded yet
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg not downloaded yet
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_8009c915cc9cc816f20a34c801e87e22.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_e94abeaa132a52382e66e11f82cca427.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_a0654b8f854ad3c930d586cabebe8c58.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_a0654b8f854ad3c930d586cabebe8c58.jpg not downloaded yet
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274de3d0>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_ff48638a394f73c87a64c216a8d380b6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_ff48638a394f73c87a64c216a8d380b6.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726539050>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_c94822e2fc202b031525b45cdf3fddbf.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_c94822e2fc202b031525b45cdf3fddbf.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 524116d5-29ac-5c86-b2ca-f48376e425c8 with identifier: VV48329
2026-03-28 11:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524116d5-29ac-5c86-b2ca-f48376e425c8 with scrape type 1
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg not downloaded yet
2026-03-28 11:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-28 11:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602bfb9c-aebb-50d7-919a-bdba3935274d with scrape type 1
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 602bfb9c-aebb-50d7-919a-bdba3935274d
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_041062db890961afaac4b31926f78f84.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_041062db890961afaac4b31926f78f84.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_f031c6b079475dfb34920cee0eeba6e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_f031c6b079475dfb34920cee0eeba6e2.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_2f9e0559e3981009e045a3244a383564.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2f9e0559e3981009e045a3244a383564.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_1dfce3294dcc4acab44d52e220b308df.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_1dfce3294dcc4acab44d52e220b308df.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_607de51a5faf506f6ed7e042b6e357a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_607de51a5faf506f6ed7e042b6e357a4.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_68ed593049b4724de00f9f2800cbd4be.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_68ed593049b4724de00f9f2800cbd4be.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_9e494c3e2e9f012887860499ecad39e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_9e494c3e2e9f012887860499ecad39e8.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_b32cb35234ca1341c95639133b0514fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_b32cb35234ca1341c95639133b0514fa.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_2dab9687a30dca9e444b80ebf2139658.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2dab9687a30dca9e444b80ebf2139658.jpg already downloaded
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd3%252F96d37a6012ebf56ff1f1d7a00972af16%252Fpa%252FYJ22884_df5f0b73bb7d009cabee77f4786ef67c.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_df5f0b73bb7d009cabee77f4786ef67c.jpg already downloaded
2026-03-28 11:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 602bfb9c-aebb-50d7-919a-bdba3935274d, identifier: YJ22884
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267b1dd0>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d602610>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_7237de7614e94e82350ac1be2d9cfa28.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_7237de7614e94e82350ac1be2d9cfa28.jpg saved to cache
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72702be90>
2026-03-28 11:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726580b90>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_1754d3c785b30da32b18146eba3d3634.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_1754d3c785b30da32b18146eba3d3634.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d371d10>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_941556fae871003db631591e60ad8cbe.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_941556fae871003db631591e60ad8cbe.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_6d4065b35b99824411e875cd7c924a23.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_1de3730cfd7184350bb0f2785508aace.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_9b9956521904392a7d4146574b29f34e.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_9b9956521904392a7d4146574b29f34e.jpg not downloaded yet
2026-03-28 11:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-28 11:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884
2026-03-28 11:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 602bfb9c-aebb-50d7-919a-bdba3935274d with identifier: YJ22884 to the API
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ22884>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'diesel',
 'id': '602bfb9c-aebb-50d7-919a-bdba3935274d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ22884',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 168516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_041062db890961afaac4b31926f78f84.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_f031c6b079475dfb34920cee0eeba6e2.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2f9e0559e3981009e045a3244a383564.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_1dfce3294dcc4acab44d52e220b308df.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_607de51a5faf506f6ed7e042b6e357a4.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_68ed593049b4724de00f9f2800cbd4be.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_9e494c3e2e9f012887860499ecad39e8.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_b32cb35234ca1341c95639133b0514fa.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2dab9687a30dca9e444b80ebf2139658.jpg',
                'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_df5f0b73bb7d009cabee77f4786ef67c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_041062db890961afaac4b31926f78f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_f031c6b079475dfb34920cee0eeba6e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2f9e0559e3981009e045a3244a383564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_1dfce3294dcc4acab44d52e220b308df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_607de51a5faf506f6ed7e042b6e357a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_68ed593049b4724de00f9f2800cbd4be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_9e494c3e2e9f012887860499ecad39e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_b32cb35234ca1341c95639133b0514fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_2dab9687a30dca9e444b80ebf2139658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_602bfb9c-aebb-50d7-919a-bdba3935274d/602bfb9c-aebb-50d7-919a-bdba3935274d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d3/96d37a6012ebf56ff1f1d7a00972af16/pa/YJ22884_df5f0b73bb7d009cabee77f4786ef67c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ22884%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [auto1.es] INFO: Saving data for YJ22884: {'created_time': 1774695692.520443, 'last_price_update_time': 1774695692.520462, 'auction_closing_time': 1774883697.0}
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ22884') HTTP/1.1" 204 0
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_bc638447c18723de61eef29b865d4aeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_bc638447c18723de61eef29b865d4aeb.jpg not downloaded yet
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_8705dcd5d4feded63cec0f67816040e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_4d048cb2415df71f8a26be0192763df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_336b196ef1bfd15a724dc388169200f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_336b196ef1bfd15a724dc388169200f6.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg not downloaded yet
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d7050>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_0580d9bc5453d56113d4a6921244b287.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_0580d9bc5453d56113d4a6921244b287.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273a9810>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_27d4729e67365e775cc514f6d81ef6b3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_27d4729e67365e775cc514f6d81ef6b3.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273a8ed0>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_8009c915cc9cc816f20a34c801e87e22.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_8009c915cc9cc816f20a34c801e87e22.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267a2010>
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_e94abeaa132a52382e66e11f82cca427.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_e94abeaa132a52382e66e11f82cca427.jpg saved to cache
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg not downloaded yet
2026-03-28 11:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_c23ab606333fcad949bea5bff874d454.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_c23ab606333fcad949bea5bff874d454.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_5bae31649bc2f016644cec62a92b6136.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_5bae31649bc2f016644cec62a92b6136.jpg not downloaded yet
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_246fbd0499d7a4e991e2a568e04715f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_246fbd0499d7a4e991e2a568e04715f4.jpg not downloaded yet
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271e6110>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_6d4065b35b99824411e875cd7c924a23.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_6d4065b35b99824411e875cd7c924a23.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726740450>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_1de3730cfd7184350bb0f2785508aace.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_1de3730cfd7184350bb0f2785508aace.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_dd1fe3a6839419a126af838257e6f4b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_4bb1f495e70527aa5585e96d71002055.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_4bb1f495e70527aa5585e96d71002055.jpg not downloaded yet
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710d350>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252Fad%252F12adf1ca8d48a741b0a4f18f2670f52a%252Fpa%252FKH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf
2026-03-28 11:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf, skipping ID generation
2026-03-28 11:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with scrape type 1
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf sending to next pipeline
2026-03-28 11:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf, identifier: KH51643
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272d5490>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272abc50>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72653ca10>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_8705dcd5d4feded63cec0f67816040e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_8705dcd5d4feded63cec0f67816040e8.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72da92d50>
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_4d048cb2415df71f8a26be0192763df1.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_4d048cb2415df71f8a26be0192763df1.jpg saved to cache
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:33 [auto1.es] INFO: Channel: 24h | Page: 15 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with identifier: KH51643
2026-03-28 11:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with identifier: KH51643
2026-03-28 11:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 952cf5b2-cf97-5fd9-87c0-5752f95bc5cf with identifier: KH51643 to the API
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.7L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'diesel',
 'id': '952cf5b2-cf97-5fd9-87c0-5752f95bc5cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH51643',
 'listing': 'auction',
 'location': 'ES, Torrejon de Ardoz',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 217956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_c2df646594125ec1c543ffee4193944b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_19a889f7a0dd4f37801cbdff0486e617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_ff48638a394f73c87a64c216a8d380b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_1754d3c785b30da32b18146eba3d3634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_8009c915cc9cc816f20a34c801e87e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952cf5b2-cf97-5fd9-87c0-5752f95bc5cf/952cf5b2-cf97-5fd9-87c0-5752f95bc5cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/ad/12adf1ca8d48a741b0a4f18f2670f52a/pa/KH51643_21d02ed9645fb0462e9d8f07fe343bfa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2010}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH51643%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Saving data for KH51643: {'created_time': 1774695693.751481, 'last_price_update_time': 1774695693.751493, 'auction_closing_time': 1774883836.0}
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH51643') HTTP/1.1" 204 0
2026-03-28 11:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_df74b78507a618f23785cffaa38a1be0.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7f753340516ea9e0558da2d6eb771850.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg not downloaded yet
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: HR03779
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR03779%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for HR03779: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: XH48089
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: AM70674
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM70674%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for AM70674: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: WY37005
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: YD82310
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: NM83304
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM83304%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for NM83304: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: JY28028
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: AK94783
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK94783%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for AK94783: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: KP85187
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP85187%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for KP85187: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: LM23612
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM23612%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for LM23612: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: ZJ79467
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: YB91209
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB91209%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for YB91209: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: VM24550
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: YY16835
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: PC46178
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC46178%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for PC46178: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: FN37558
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: DB28446
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: KS53937
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: FX87163
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: UK11838
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: NW63422
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: GZ61403
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ61403%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for GZ61403: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: BP61591
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: SC27418
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC27418%27 HTTP/1.1" 200 None
2026-03-28 11:01:33 [auto1.es] INFO: Scrape type for SC27418: 0
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: LS69638
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: WF15705
2026-03-28 11:01:33 [auto1.es] INFO: Found listing with ID: NJ68356
2026-03-28 11:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ68356%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for NJ68356: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: LC97484
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC97484%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for LC97484: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: NP49445
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: FR82793
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR82793%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for FR82793: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: HJ26610
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: LF82591
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: HW63971
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: GU42237
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU42237%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for GU42237: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: RH35807
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: HN32774
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: LC37713
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC37713%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for LC37713: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: MZ99822
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ99822%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [auto1.es] INFO: Scrape type for MZ99822: 0
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: YS28184
2026-03-28 11:01:34 [auto1.es] INFO: Found listing with ID: VR49277
2026-03-28 11:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272c6f90>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727475790>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_87742b2df457b5a2554ad06f0ab4a587.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_9b9956521904392a7d4146574b29f34e.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_8995d48d0422edd1550198aa5fc9f8de.jpg%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_8995d48d0422edd1550198aa5fc9f8de.jpg not downloaded yet
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727242990>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_dd1fe3a6839419a126af838257e6f4b5.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_dd1fe3a6839419a126af838257e6f4b5.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb727376f10>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72679d6d0>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_df74b78507a618f23785cffaa38a1be0.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_df74b78507a618f23785cffaa38a1be0.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72679fe10>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_7f753340516ea9e0558da2d6eb771850.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7f753340516ea9e0558da2d6eb771850.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72746c810>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272bbb50>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726611e50>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72700dc10>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_87742b2df457b5a2554ad06f0ab4a587.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_87742b2df457b5a2554ad06f0ab4a587.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726797350>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_9b9956521904392a7d4146574b29f34e.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_9b9956521904392a7d4146574b29f34e.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_a0654b8f854ad3c930d586cabebe8c58.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_bc638447c18723de61eef29b865d4aeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272b8d90>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72d603750>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272b8250>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_246fbd0499d7a4e991e2a568e04715f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_4bb1f495e70527aa5585e96d71002055.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_c23ab606333fcad949bea5bff874d454.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_8995d48d0422edd1550198aa5fc9f8de.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_5bae31649bc2f016644cec62a92b6136.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7267e82d0>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg saved to cache
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266d5d90>
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_a0654b8f854ad3c930d586cabebe8c58.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_a0654b8f854ad3c930d586cabebe8c58.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7273d4f50>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_bc638447c18723de61eef29b865d4aeb.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_bc638447c18723de61eef29b865d4aeb.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272a39d0>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270c0590>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_336b196ef1bfd15a724dc388169200f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_a19032a144ee3ee09bb304a728c5bad2.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_2875a2737e97383dce067ace8549eea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7272ad150>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F59%252F1d596e550c3b4d859b3b907beaf38a9a%252Fpa%252FRU20773_246fbd0499d7a4e991e2a568e04715f4.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_246fbd0499d7a4e991e2a568e04715f4.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 753fe24e-17d6-5c03-9437-20017b0c39f0
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 753fe24e-17d6-5c03-9437-20017b0c39f0, skipping ID generation
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753fe24e-17d6-5c03-9437-20017b0c39f0 with scrape type 1
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 753fe24e-17d6-5c03-9437-20017b0c39f0 sending to next pipeline
2026-03-28 11:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 753fe24e-17d6-5c03-9437-20017b0c39f0, identifier: RU20773
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726750710>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_4bb1f495e70527aa5585e96d71002055.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_4bb1f495e70527aa5585e96d71002055.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72651ec50>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72746c450>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_c23ab606333fcad949bea5bff874d454.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_c23ab606333fcad949bea5bff874d454.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7274ef910>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_8995d48d0422edd1550198aa5fc9f8de.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_8995d48d0422edd1550198aa5fc9f8de.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7266d5790>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F07%252Fe0076f1a450c4a176b3d6f0dab4c5889%252Fpa%252FZK54179_5bae31649bc2f016644cec62a92b6136.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_5bae31649bc2f016644cec62a92b6136.jpg saved to cache
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51, skipping ID generation
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with scrape type 1
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 sending to next pipeline
2026-03-28 11:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51, identifier: ZK54179
2026-03-28 11:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 753fe24e-17d6-5c03-9437-20017b0c39f0 with identifier: RU20773
2026-03-28 11:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 753fe24e-17d6-5c03-9437-20017b0c39f0 with identifier: RU20773
2026-03-28 11:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 753fe24e-17d6-5c03-9437-20017b0c39f0 with identifier: RU20773 to the API
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_246fbd0499d7a4e991e2a568e04715f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:49:29Z',
 'fuel_type': 'diesel',
 'id': '753fe24e-17d6-5c03-9437-20017b0c39f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU20773',
 'listing': 'auction',
 'location': 'ES, Atarfe, Granada',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 102792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_b8c3f7855c10ed28952a6bce86e6f7f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_941556fae871003db631591e60ad8cbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_1de3730cfd7184350bb0f2785508aace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_8705dcd5d4feded63cec0f67816040e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_ff73de32ef69d2a48b3d9bfc92901000.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_df74b78507a618f23785cffaa38a1be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_f440ad03c8b2e480a9b2a6a6f77b7fc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_9b9956521904392a7d4146574b29f34e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_fa57540e21747fcb5ec84fbabfa979ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_753fe24e-17d6-5c03-9437-20017b0c39f0/753fe24e-17d6-5c03-9437-20017b0c39f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1d/59/1d596e550c3b4d859b3b907beaf38a9a/pa/RU20773_246fbd0499d7a4e991e2a568e04715f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2015}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU20773%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [auto1.es] INFO: Saving data for RU20773: {'created_time': 1774695696.044377, 'last_price_update_time': 1774695696.044389, 'auction_closing_time': 1774885769.0}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RU20773') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with identifier: ZK54179
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with identifier: ZK54179
2026-03-28 11:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51 with identifier: ZK54179 to the API
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_5bae31649bc2f016644cec62a92b6136.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:27Z',
 'fuel_type': 'diesel',
 'id': 'ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK54179',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 275587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7580f93ec7b51fcd09ef78cb8aaf588a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_0580d9bc5453d56113d4a6921244b287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b5a96cc42d7cb262057363e1df30cf63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_b28cf0ae2c3e4422de11071e73076e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_3bc6c4619777aa8a6f5e221f861e3e13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_7f753340516ea9e0558da2d6eb771850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_bdf28f11023779e6517a3d98d9fd5d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_c3fe76b4b8113982e1ce94a1cba37697.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_33f20f7a4f75a6487562b04236ef88e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51/ffdc6a89-6a9e-5ee5-95e7-b47e23d4bc51_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/07/e0076f1a450c4a176b3d6f0dab4c5889/pa/ZK54179_5bae31649bc2f016644cec62a92b6136.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK54179%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [auto1.es] INFO: Saving data for ZK54179: {'created_time': 1774695696.555073, 'last_price_update_time': 1774695696.555082, 'auction_closing_time': 1774884027.0}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK54179') HTTP/1.1" 204 0
2026-03-28 11:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_959c12657c8009797babda8fd877a98c.jpg> (referer: https://www.auto1.com/)
2026-03-28 11:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270bb810>
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_336b196ef1bfd15a724dc388169200f6.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_336b196ef1bfd15a724dc388169200f6.jpg saved to cache
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb72710d0d0>
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F5e%252F705edb9fd292c141f514d9b18018aa88%252Fpa%252FVV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg saved to cache
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 524116d5-29ac-5c86-b2ca-f48376e425c8
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 524116d5-29ac-5c86-b2ca-f48376e425c8, skipping ID generation
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524116d5-29ac-5c86-b2ca-f48376e425c8 with scrape type 1
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 524116d5-29ac-5c86-b2ca-f48376e425c8 sending to next pipeline
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 524116d5-29ac-5c86-b2ca-f48376e425c8, identifier: VV48329
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7271cf0d0>
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_a19032a144ee3ee09bb304a728c5bad2.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_a19032a144ee3ee09bb304a728c5bad2.jpg saved to cache
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb726503250>
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F28%252Fe528ad369f7c0ee3e7dd1175b9bcf9f8%252Fpa%252FCV66475_2875a2737e97383dce067ace8549eea9.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_2875a2737e97383dce067ace8549eea9.jpg saved to cache
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b18bfee5-1c90-5131-8cd3-6e60271c5f77
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b18bfee5-1c90-5131-8cd3-6e60271c5f77, skipping ID generation
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18bfee5-1c90-5131-8cd3-6e60271c5f77 with scrape type 1
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b18bfee5-1c90-5131-8cd3-6e60271c5f77 sending to next pipeline
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b18bfee5-1c90-5131-8cd3-6e60271c5f77, identifier: CV66475
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 524116d5-29ac-5c86-b2ca-f48376e425c8 with identifier: VV48329
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 524116d5-29ac-5c86-b2ca-f48376e425c8 with identifier: VV48329
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 524116d5-29ac-5c86-b2ca-f48376e425c8 with identifier: VV48329 to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': '524116d5-29ac-5c86-b2ca-f48376e425c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV48329',
 'listing': 'auction',
 'location': 'ES, Zaragoza',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 237222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_da7eb16bb601ffb777342ce7491bbfdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_bc638447c18723de61eef29b865d4aeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_13b2ad7d5b3fffabb0e80ca0f2d72128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_4bb1f495e70527aa5585e96d71002055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_e40738a1f72d6486b3cc7b6b526d1576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524116d5-29ac-5c86-b2ca-f48376e425c8/524116d5-29ac-5c86-b2ca-f48376e425c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/5e/705edb9fd292c141f514d9b18018aa88/pa/VV48329_8995d48d0422edd1550198aa5fc9f8de.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.6 Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2006}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48329%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.es] INFO: Saving data for VV48329: {'created_time': 1774695697.314804, 'last_price_update_time': 1774695697.314818, 'auction_closing_time': 1774882807.0}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV48329') HTTP/1.1" 204 0
2026-03-28 11:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b18bfee5-1c90-5131-8cd3-6e60271c5f77 with identifier: CV66475
2026-03-28 11:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b18bfee5-1c90-5131-8cd3-6e60271c5f77 with identifier: CV66475
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b18bfee5-1c90-5131-8cd3-6e60271c5f77 with identifier: CV66475 to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_2875a2737e97383dce067ace8549eea9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:29:51Z',
 'fuel_type': 'hybrid',
 'id': 'b18bfee5-1c90-5131-8cd3-6e60271c5f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV66475',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 67395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_7237de7614e94e82350ac1be2d9cfa28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_e94abeaa132a52382e66e11f82cca427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_f09cd82aaa6b41ef75912ab5b337b8e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_dd1fe3a6839419a126af838257e6f4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_2875a2737e97383dce067ace8549eea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_a19032a144ee3ee09bb304a728c5bad2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_80afc66688a52ebdd50cb976d6a70b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_8b2423b954fc9a9755bfc0a3ceec91c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_336b196ef1bfd15a724dc388169200f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18bfee5-1c90-5131-8cd3-6e60271c5f77/b18bfee5-1c90-5131-8cd3-6e60271c5f77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/28/e528ad369f7c0ee3e7dd1175b9bcf9f8/pa/CV66475_c23ab606333fcad949bea5bff874d454.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV Top 4WD',
 'transmission': 'automatic',
 'trim': 'Top 4WD',
 'year': 2021}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV66475%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [auto1.es] INFO: Saving data for CV66475: {'created_time': 1774695697.719378, 'last_price_update_time': 1774695697.719388, 'auction_closing_time': 1774884591.0}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV66475') HTTP/1.1" 204 0
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb7270b8050>
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fb8%252Fe5b838462dc57c6af76f4ad22ef3eaa3%252Fpa%252FCY52892_959c12657c8009797babda8fd877a98c.jpg') HTTP/1.1" 204 0
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_959c12657c8009797babda8fd877a98c.jpg saved to cache
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 519cdc8d-82e4-5c66-b350-a68130b19e3c
2026-03-28 11:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 519cdc8d-82e4-5c66-b350-a68130b19e3c, skipping ID generation
2026-03-28 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 519cdc8d-82e4-5c66-b350-a68130b19e3c with scrape type 1
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 519cdc8d-82e4-5c66-b350-a68130b19e3c sending to next pipeline
2026-03-28 11:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 519cdc8d-82e4-5c66-b350-a68130b19e3c, identifier: CY52892
2026-03-28 11:01:37 [auto1.es] INFO: Channel: 24h | Page: 16 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 519cdc8d-82e4-5c66-b350-a68130b19e3c with identifier: CY52892
2026-03-28 11:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 519cdc8d-82e4-5c66-b350-a68130b19e3c with identifier: CY52892
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 519cdc8d-82e4-5c66-b350-a68130b19e3c with identifier: CY52892 to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_959c12657c8009797babda8fd877a98c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:02Z',
 'fuel_type': 'diesel',
 'id': '519cdc8d-82e4-5c66-b350-a68130b19e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY52892',
 'listing': 'auction',
 'location': 'ES, Churra (Murcia)',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 234516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_db82c89592746aa171a6d91f2c091e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_1833d8af09b559e2376f4c881c3dfd4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_c94822e2fc202b031525b45cdf3fddbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_27d4729e67365e775cc514f6d81ef6b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_6d4065b35b99824411e875cd7c924a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_4d048cb2415df71f8a26be0192763df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_959c12657c8009797babda8fd877a98c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_87742b2df457b5a2554ad06f0ab4a587.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_0b1ee39bfc18b52920ea9deb5b8e528f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_519cdc8d-82e4-5c66-b350-a68130b19e3c/519cdc8d-82e4-5c66-b350-a68130b19e3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/b8/e5b838462dc57c6af76f4ad22ef3eaa3/pa/CY52892_a0654b8f854ad3c930d586cabebe8c58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY52892%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Saving data for CY52892: {'created_time': 1774695698.254519, 'last_price_update_time': 1774695698.25453, 'auction_closing_time': 1774883582.0}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CY52892') HTTP/1.1" 204 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: FJ90358
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: TU72594
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: CR48575
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: WR24367
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: VL94048
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: TW02627
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW02627%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for TW02627: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: AE32204
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: JE65744
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE65744%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for JE65744: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: PF77952
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: HR81146
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR81146%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for HR81146: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: YD06754
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: WD69770
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: JG96257
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG96257%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for JG96257: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: JZ51794
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ51794%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for JZ51794: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: RB01014
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB01014%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for RB01014: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: LK62452
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: RL13967
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL13967%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for RL13967: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: PG01286
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG01286%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for PG01286: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: YT35531
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: JF42327
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF42327%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for JF42327: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: UR00464
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: WV47930
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: SH75312
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH75312%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for SH75312: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: DM90018
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: WM47601
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: LS55149
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS55149%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for LS55149: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: TD48491
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: ZJ95453
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ95453%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for ZJ95453: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: FC13262
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: RP86418
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP86418%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for RP86418: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: SM64355
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: NU52184
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: FY50963
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY50963%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for FY50963: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: NN48613
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN48613%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for NN48613: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: AZ28710
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ28710%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for AZ28710: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: TC59600
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: VP39561
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP39561%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [auto1.es] INFO: Scrape type for VP39561: 0
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: EU66649
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: FY66249
2026-03-28 11:01:38 [auto1.es] INFO: Found listing with ID: PR87201
2026-03-28 11:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:39 [auto1.es] INFO: Channel: 24h | Page: 17 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: FK50092
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50092%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for FK50092: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: ZJ44850
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: PZ33789
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: WZ85087
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ85087%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for WZ85087: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: LP06915
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP06915%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for LP06915: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: GD92135
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD92135%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for GD92135: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: ZE71239
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: RK72644
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK72644%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for RK72644: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: AC50024
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC50024%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for AC50024: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: JK92446
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK92446%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for JK92446: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: UP55531
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: WD98300
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: DR19910
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR19910%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for DR19910: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: WA10977
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA10977%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for WA10977: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: BF22404
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF22404%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for BF22404: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: MF04433
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: VV66247
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV66247%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for VV66247: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: BK72591
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK72591%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for BK72591: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: NV84448
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV84448%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for NV84448: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: FH30373
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH30373%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for FH30373: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: TB24356
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB24356%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for TB24356: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: TA73897
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TA73897%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for TA73897: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: WG98827
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG98827%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for WG98827: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: TF48403
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF48403%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for TF48403: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: EV89270
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89270%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for EV89270: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: GA27189
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: UG25415
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG25415%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for UG25415: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: XG18917
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG18917%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [auto1.es] INFO: Scrape type for XG18917: 0
2026-03-28 11:01:39 [auto1.es] INFO: Found listing with ID: WJ72825
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ72825%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for WJ72825: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: YN66456
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: UT89838
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: DW22650
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW22650%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for DW22650: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: WL78686
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: ZL13799
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL13799%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for ZL13799: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: GU11449
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: DG38450
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: MR72452
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR72452%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for MR72452: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: KF98963
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF98963%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for KF98963: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: BT14659
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT14659%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for BT14659: 0
2026-03-28 11:01:40 [auto1.es] INFO: Found listing with ID: EK65360
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK65360%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [auto1.es] INFO: Scrape type for EK65360: 0
2026-03-28 11:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:41 [auto1.es] INFO: Channel: 24h | Page: 18 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: WC72839
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: ZK05634
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK05634%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for ZK05634: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: LM00276
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: GZ25501
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ25501%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for GZ25501: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: AP64708
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: SE84848
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: KW07393
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: EH84467
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: ZW00345
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW00345%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for ZW00345: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: SZ42428
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: WH24419
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: YG93174
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG93174%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for YG93174: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: EH99000
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: FX85730
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: TN34966
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: SH03418
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for SH03418: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: EV20244
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV20244%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for EV20244: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: NA23399
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA23399%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for NA23399: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: DV59548
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV59548%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for DV59548: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: YG50456
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: TU21075
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: AV16131
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: JW81079
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW81079%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for JW81079: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: PS31871
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS31871%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for PS31871: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: BE63337
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE63337%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for BE63337: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: XJ28313
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: FJ85779
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: MJ22041
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22041%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for MJ22041: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: BV18028
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: HG47154
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47154%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for HG47154: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: SN53081
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: RC21123
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: ZX16676
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZX16676%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for ZX16676: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: FZ38414
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ38414%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [auto1.es] INFO: Scrape type for FZ38414: 0
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: LH19294
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: XE96184
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: GY33906
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: HY73546
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: MK12831
2026-03-28 11:01:41 [auto1.es] INFO: Found listing with ID: WS59204
2026-03-28 11:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:42 [auto1.es] INFO: Channel: 24h | Page: 19 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: PT59425
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: TX02408
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02408%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for TX02408: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: YG37812
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: DE32472
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE32472%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for DE32472: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: PJ49539
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: PP21573
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP21573%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for PP21573: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: RJ04030
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ04030%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for RJ04030: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: LK18237
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK18237%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for LK18237: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: GS46060
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS46060%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for GS46060: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: JJ86148
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: HW81498
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: JX49148
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: AF00025
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF00025%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for AF00025: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: NM59518
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: RJ55423
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ55423%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for RJ55423: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: TU32370
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: RS43039
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS43039%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for RS43039: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: FF66391
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF66391%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for FF66391: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: TU27127
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU27127%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for TU27127: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: TU02735
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: KT63961
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: KG64326
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: WV75018
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: XD33524
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD33524%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for XD33524: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: MH48496
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH48496%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for MH48496: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: TX48554
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: DW56939
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: WA73685
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: AG21540
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: RE29588
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: KG74250
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: XV71103
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: ZG15911
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG15911%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for ZG15911: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: ZL22233
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL22233%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for ZL22233: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: WL57224
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL57224%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for WL57224: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: SA46382
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA46382%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for SA46382: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: HS16028
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: AK39798
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: GA00375
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA00375%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for GA00375: 0
2026-03-28 11:01:42 [auto1.es] INFO: Found listing with ID: ER64575
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER64575%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [auto1.es] INFO: Scrape type for ER64575: 0
2026-03-28 11:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:43 [auto1.es] INFO: Channel: 24h | Page: 20 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: PD85443
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: FR28511
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: CK41460
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: BC07750
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: YR87797
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: NN09509
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN09509%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for NN09509: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: US86710
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US86710%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for US86710: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: AS83743
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: ML55356
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: FG99809
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for FG99809: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: WY05538
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: FF26714
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: JB16763
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB16763%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for JB16763: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: KY38332
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: MN54657
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: MV29713
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: FL07647
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: ZJ56625
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ56625%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for ZJ56625: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: XB50501
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: XH86580
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH86580%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for XH86580: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: RM85615
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM85615%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for RM85615: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: AG32524
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG32524%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for AG32524: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: WF53807
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF53807%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for WF53807: 0
2026-03-28 11:01:43 [auto1.es] INFO: Found listing with ID: US15459
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US15459%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [auto1.es] INFO: Scrape type for US15459: 2
2026-03-28 11:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56902d2-e9f7-5a14-915d-26814d22b49d with identifier: US15459
2026-03-28 11:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56902d2-e9f7-5a14-915d-26814d22b49d with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56902d2-e9f7-5a14-915d-26814d22b49d with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f56902d2-e9f7-5a14-915d-26814d22b49d, identifier: US15459
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f56902d2-e9f7-5a14-915d-26814d22b49d with identifier: US15459
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f56902d2-e9f7-5a14-915d-26814d22b49d with identifier: US15459
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f56902d2-e9f7-5a14-915d-26814d22b49d with identifier: US15459 to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:55:17Z',
 'fuel_type': 'diesel',
 'id': 'f56902d2-e9f7-5a14-915d-26814d22b49d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US15459',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 151912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Essential 4x4',
 'transmission': 'manual',
 'trim': 'Essential 4x4',
 'year': 2018}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US15459%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.es] INFO: Saving data for US15459: {'auction_closing_time': 1774716917.0, 'created_time': 1774512022.56251, 'last_price_update_time': 1774695704.550298}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US15459') HTTP/1.1" 204 0
2026-03-28 11:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: KE50509
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE50509%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.es] INFO: Scrape type for KE50509: 0
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: NX73421
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: YY12745
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: LD17478
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: FH07549
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: PF82044
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: BY63311
2026-03-28 11:01:44 [auto1.es] INFO: Found listing with ID: DR60635
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR60635%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.es] INFO: Scrape type for DR60635: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b605f172-3bbb-516a-a9e8-4125186801bd with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b605f172-3bbb-516a-a9e8-4125186801bd with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b605f172-3bbb-516a-a9e8-4125186801bd, identifier: DR60635
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b605f172-3bbb-516a-a9e8-4125186801bd with identifier: DR60635 to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:38:03Z',
 'fuel_type': 'diesel',
 'id': 'b605f172-3bbb-516a-a9e8-4125186801bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR60635',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business BlueMotion',
 'year': 2018}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR60635%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.es] INFO: Saving data for DR60635: {'auction_closing_time': 1774715883.0, 'created_time': 1774512024.845997, 'last_price_update_time': 1774695705.125522}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DR60635') HTTP/1.1" 204 0
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: CY33639
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: YH86623
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH86623%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.es] INFO: Scrape type for YH86623: 0
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: LH99658
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: PD45625
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: GD38057
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: RK74623
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: PT78708
2026-03-28 11:01:45 [auto1.es] INFO: Found listing with ID: WF38269
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF38269%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.es] INFO: Scrape type for WF38269: 0
2026-03-28 11:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:46 [auto1.es] INFO: Channel: 24h | Page: 21 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: SP90051
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: ZT52456
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: YP26589
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: BM87438
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM87438%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for BM87438: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: LD07198
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD07198%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for LD07198: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: RB88414
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB88414%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for RB88414: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: RD88147
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: NF50225
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: HK38908
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK38908%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for HK38908: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: BF57593
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF57593%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for BF57593: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: DL26730
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: JR29098
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR29098%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for JR29098: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: JB62304
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: SP20451
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: YE50848
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: VG19882
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19882%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for VG19882: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: YK51395
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: AG66489
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: HY26691
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: XB87201
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB87201%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for XB87201: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: BX65620
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX65620%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for BX65620: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: BF21105
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF21105%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for BF21105: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: HT23405
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: ST42885
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: GF99536
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: UJ65320
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ65320%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for UJ65320: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: RU65769
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RU65769%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for RU65769: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: WW31091
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: PT77544
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: YG72070
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: MM73463
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MM73463%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for MM73463: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: ZD58886
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD58886%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for ZD58886: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: BX60688
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: DW27035
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW27035%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for DW27035: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: EB96855
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: XJ69303
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: UY47592
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY47592%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for UY47592: 0
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: HH46764
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: YB94347
2026-03-28 11:01:46 [auto1.es] INFO: Found listing with ID: NZ09379
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ09379%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.es] INFO: Scrape type for NZ09379: 0
2026-03-28 11:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:47 [auto1.es] INFO: Channel: 24h | Page: 22 | totalHits: 2550 | hits on page: 40
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: XY25635
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: MN96118
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN96118%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for MN96118: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: SL72652
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL72652%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for SL72652: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: JP30275
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: BW95892
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW95892%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for BW95892: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: HX96572
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HX96572%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for HX96572: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: JX80621
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX80621%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for JX80621: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: SF77258
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: XR92407
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: NT36194
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: PU11377
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU11377%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for PU11377: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: PC22199
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: AG75766
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG75766%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for AG75766: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: XY83185
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY83185%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for XY83185: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: MW26851
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: ML17412
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML17412%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for ML17412: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: BZ29136
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: BU72892
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: AB84528
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB84528%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for AB84528: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: RC36042
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC36042%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for RC36042: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: MK04112
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK04112%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for MK04112: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: JX17367
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: KM36431
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: WC35260
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC35260%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for WC35260: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: PX21457
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX21457%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for PX21457: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: ZF10967
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: JK64156
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: RW45199
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RW45199%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for RW45199: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: BA78017
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BA78017%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for BA78017: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: WT17927
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT17927%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for WT17927: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: JM88117
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM88117%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for JM88117: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: NL01564
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL01564%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for NL01564: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: GG08550
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG08550%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [auto1.es] INFO: Scrape type for GG08550: 0
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: VJ61689
2026-03-28 11:01:47 [auto1.es] INFO: Found listing with ID: MA92923
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA92923%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.es] INFO: Scrape type for MA92923: 0
2026-03-28 11:01:48 [auto1.es] INFO: Found listing with ID: MG47386
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG47386%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.es] INFO: Scrape type for MG47386: 0
2026-03-28 11:01:48 [auto1.es] INFO: Found listing with ID: UD80780
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD80780%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.es] INFO: Scrape type for UD80780: 0
2026-03-28 11:01:48 [auto1.es] INFO: Found listing with ID: BF82327
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF82327%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.es] INFO: Scrape type for BF82327: 0
2026-03-28 11:01:48 [auto1.es] INFO: Found listing with ID: MH30055
2026-03-28 11:01:48 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [auto1.es] INFO: Scrape type for CE45579: 0
2026-03-28 11:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:05 [scrapy.extensions.logstats] INFO: Crawled 138 pages (at 43 pages/min), scraped 74 items (at 31 items/min)
2026-03-28 11:02:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-28 11:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:19 [auto1.es] INFO: Channel: 24h | Page: 23 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: MH30055
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: CE45579
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE45579%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for CE45579: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: KS98335
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS98335%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for KS98335: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YL06778
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SK01159
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SS95298
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SS95298%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for SS95298: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: PZ99435
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: AA63946
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: LL40861
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL40861%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for LL40861: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YL34665
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: VJ44998
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ44998%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for VJ44998: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: XX41183
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YH27551
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SE78782
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE78782%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for SE78782: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: RR55958
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: PD17011
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: EA52375
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA52375%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for EA52375: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: GG28459
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG28459%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for GG28459: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: HK75942
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK75942%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for HK75942: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: CZ94183
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: ZA55994
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: PC51622
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SN64789
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: HK12855
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: JH04975
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JH04975%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for JH04975: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: EN87990
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: XH57732
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH57732%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for XH57732: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: AK39366
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: KH58468
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH58468%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for KH58468: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: MG44284
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SL52436
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL52436%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for SL52436: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: SR43030
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR43030%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for SR43030: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: KA53373
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: PF81025
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF81025%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for PF81025: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: ZP63371
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YF13100
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YR71719
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: YW89108
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW89108%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for YW89108: 0
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: DW38851
2026-03-28 11:02:19 [auto1.es] INFO: Found listing with ID: GU69943
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU69943%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [auto1.es] INFO: Scrape type for GU69943: 0
2026-03-28 11:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:21 [auto1.es] INFO: Channel: 24h | Page: 24 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: YU31002
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU31002%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for YU31002: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: NA15103
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: AV80298
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV80298%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for AV80298: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: WX54724
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX54724%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for WX54724: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: LC77404
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: NC39762
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: UJ64573
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ64573%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for UJ64573: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: PZ51501
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ51501%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for PZ51501: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: EV89991
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV89991%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for EV89991: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: YZ29146
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ29146%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for YZ29146: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: UD79775
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD79775%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for UD79775: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: LL26626
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL26626%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for LL26626: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: EG32676
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG32676%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for EG32676: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: LJ17075
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: CN46922
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: PU35155
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: GT40833
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: XZ52900
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: US62841
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US62841%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for US62841: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: NF79265
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79265%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for NF79265: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: WT21682
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT21682%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for WT21682: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: CN05073
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN05073%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for CN05073: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: VP11478
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: VG29597
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: GT09442
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT09442%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for GT09442: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: AY69334
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY69334%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for AY69334: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: ZT32060
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT32060%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for ZT32060: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: PK17062
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK17062%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for PK17062: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: YX85928
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YX85928%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for YX85928: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: JW07247
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: RE64316
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: RA16154
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA16154%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for RA16154: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: AR88261
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR88261%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for AR88261: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: YH68644
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: WA88394
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: PH91048
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH91048%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for PH91048: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: AK44201
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK44201%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for AK44201: 0
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: FH27641
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: EV12094
2026-03-28 11:02:21 [auto1.es] INFO: Found listing with ID: UY91237
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UY91237%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [auto1.es] INFO: Scrape type for UY91237: 0
2026-03-28 11:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:22 [auto1.es] INFO: Channel: 24h | Page: 25 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: AE81863
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE81863%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for AE81863: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: CH38483
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: KJ28856
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: FE33802
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FE33802%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for FE33802: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: JC17966
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: XZ06121
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ06121%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for XZ06121: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: HA53879
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA53879%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for HA53879: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: KG68296
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG68296%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for KG68296: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: AJ93581
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93581%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for AJ93581: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: UR41471
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR41471%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for UR41471: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: LL30707
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL30707%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for LL30707: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: CN83416
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN83416%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for CN83416: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: DE85844
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE85844%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for DE85844: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: KX46751
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX46751%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for KX46751: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: VV79755
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV79755%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for VV79755: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: BV16371
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV16371%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for BV16371: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: WL52368
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: SJ53715
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ53715%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [auto1.es] INFO: Scrape type for SJ53715: 0
2026-03-28 11:02:22 [auto1.es] INFO: Found listing with ID: SM68144
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM68144%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for SM68144: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: RC81564
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC81564%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for RC81564: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: RJ81343
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: LK68537
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: VU28227
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: ZA80784
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: PN97483
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN97483%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for PN97483: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: YZ97545
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ97545%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for YZ97545: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: BY18698
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: DR12042
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR12042%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for DR12042: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: EG74552
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG74552%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for EG74552: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: UH51284
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UH51284%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for UH51284: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: MJ33537
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: EB93661
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB93661%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for EB93661: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: HJ75824
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: DJ31574
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ31574%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for DJ31574: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: MX73277
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: KC46578
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC46578%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for KC46578: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: HC34911
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC34911%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for HC34911: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: RV14392
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: PN16892
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN16892%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for PN16892: 0
2026-03-28 11:02:23 [auto1.es] INFO: Found listing with ID: SY91056
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY91056%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [auto1.es] INFO: Scrape type for SY91056: 0
2026-03-28 11:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:24 [auto1.es] INFO: Channel: 24h | Page: 26 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: DH89256
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: YS60567
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS60567%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for YS60567: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: VL93613
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL93613%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for VL93613: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: ZR59289
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR59289%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for ZR59289: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: WA75456
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA75456%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for WA75456: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: PU00730
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU00730%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for PU00730: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: GJ83927
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: PK46399
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: CZ41335
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: XJ15260
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ15260%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for XJ15260: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: TL40717
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL40717%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for TL40717: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: MR15790
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR15790%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for MR15790: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: SG19170
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: JB47197
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: LS97770
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: ME02001
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: AV97332
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV97332%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for AV97332: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: YC67931
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC67931%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for YC67931: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: TM54521
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: NE32180
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: EW19678
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: CJ74975
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: CW02489
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: UX78126
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX78126%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for UX78126: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: VV06777
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: ZM36181
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: NJ25414
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: CP72287
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP72287%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for CP72287: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: ES00256
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES00256%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for ES00256: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: WG83508
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: JG83987
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: LE44410
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: VC68158
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: WW30264
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: SK17439
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: FC08911
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC08911%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for FC08911: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: TJ87450
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TJ87450%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for TJ87450: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: JY07683
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY07683%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for JY07683: 0
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: ET27583
2026-03-28 11:02:24 [auto1.es] INFO: Found listing with ID: RF10879
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF10879%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [auto1.es] INFO: Scrape type for RF10879: 0
2026-03-28 11:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:25 [auto1.es] INFO: Channel: 24h | Page: 27 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: SR01470
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: JC88561
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: ZV35449
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV35449%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.es] INFO: Scrape type for ZV35449: 0
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: DL51279
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: UC09258
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: HK88265
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK88265%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.es] INFO: Scrape type for HK88265: 0
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: CX27112
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX27112%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.es] INFO: Scrape type for CX27112: 0
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: DG13081
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: YH51861
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH51861%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.es] INFO: Scrape type for YH51861: 0
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: YD66722
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD66722%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [auto1.es] INFO: Scrape type for YD66722: 0
2026-03-28 11:02:25 [auto1.es] INFO: Found listing with ID: UB76587
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB76587%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for UB76587: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: YU72281
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU72281%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for YU72281: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: TW45528
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW45528%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for TW45528: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: CD57804
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD57804%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for CD57804: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: GZ44252
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: RT90695
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: BC37690
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: YH03872
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH03872%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for YH03872: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: AD89683
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: TH72342
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: GW16894
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: TA62942
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: XY35870
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY35870%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for XY35870: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: WK84423
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK84423%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for WK84423: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: NL09405
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL09405%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for NL09405: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: VY26684
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY26684%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for VY26684: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: DG34195
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG34195%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for DG34195: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: YF57320
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: DP90373
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: CY07348
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: SX15472
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX15472%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for SX15472: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: BF55946
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: SN05044
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: PD75300
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: ZL27133
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27133%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for ZL27133: 0
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: VR01411
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: GA11784
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: XN31464
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: AG74382
2026-03-28 11:02:26 [auto1.es] INFO: Found listing with ID: FA05527
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05527%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [auto1.es] INFO: Scrape type for FA05527: 0
2026-03-28 11:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:27 [auto1.es] INFO: Channel: 24h | Page: 28 | totalHits: 2552 | hits on page: 40
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: KD95768
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: ZC95482
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC95482%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for ZC95482: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: EY10319
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY10319%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for EY10319: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: KN38404
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: MY11525
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: WC31368
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: GY52926
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY52926%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for GY52926: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: PK04858
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK04858%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for PK04858: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: YC45232
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC45232%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for YC45232: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: RN76428
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: VZ27900
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: MW68540
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW68540%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for MW68540: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: VM02811
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: SA97364
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA97364%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for SA97364: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: UN48469
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: NA86164
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: SW69088
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW69088%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for SW69088: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: BW81200
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: AR07470
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR07470%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for AR07470: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: FD93505
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: VC05043
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC05043%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for VC05043: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: PW99692
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: VY79156
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: MV66149
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV66149%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for MV66149: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: GR78945
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78945%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for GR78945: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: SJ56624
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ56624%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for SJ56624: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: ZL69555
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: JC19208
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: VS82741
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: NY33487
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY33487%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for NY33487: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: CH02568
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: YA31535
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA31535%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for YA31535: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: KD09714
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD09714%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for KD09714: 0
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: RW57284
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: MJ10048
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: TF35206
2026-03-28 11:02:27 [auto1.es] INFO: Found listing with ID: YL41788
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL41788%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [auto1.es] INFO: Scrape type for YL41788: 0
2026-03-28 11:02:28 [auto1.es] INFO: Found listing with ID: CC73171
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC73171%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.es] INFO: Scrape type for CC73171: 0
2026-03-28 11:02:28 [auto1.es] INFO: Found listing with ID: EN74570
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN74570%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.es] INFO: Scrape type for EN74570: 0
2026-03-28 11:02:28 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [auto1.es] INFO: Scrape type for BM81559: 0
2026-03-28 11:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:29 [auto1.es] INFO: Channel: 24h | Page: 29 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: BM81559
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM81559%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for BM81559: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: KY27191
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: GY66563
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY66563%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for GY66563: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: EW34917
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW34917%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for EW34917: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: WC51146
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC51146%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for WC51146: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: EX52175
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EX52175%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for EX52175: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: KL17939
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: YG24338
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: NB11190
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB11190%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for NB11190: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: FH47587
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: FS24848
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: JB29857
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB29857%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for JB29857: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: ZN14981
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN14981%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for ZN14981: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: VE17467
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: ZB98870
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: RR37131
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: TX53008
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: AD15625
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD15625%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for AD15625: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: KX23330
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: UG82758
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG82758%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for UG82758: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: DA46223
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DA46223%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for DA46223: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: GY39157
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: TV93426
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: VH23688
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH23688%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for VH23688: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: MU93951
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: VU67275
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: VL75431
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL75431%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for VL75431: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: PB35716
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB35716%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for PB35716: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: WC06824
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: HV93146
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV93146%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for HV93146: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: KK58093
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK58093%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for KK58093: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: NR52566
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: WH83968
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH83968%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for WH83968: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: VB99654
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB99654%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for VB99654: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: TD60260
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: WJ41546
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ41546%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for WJ41546: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: XA12312
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: FT73766
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT73766%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [auto1.es] INFO: Scrape type for FT73766: 0
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: YM72054
2026-03-28 11:02:29 [auto1.es] INFO: Found listing with ID: UX12381
2026-03-28 11:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:30 [auto1.es] INFO: Channel: 24h | Page: 30 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: PP93305
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PP93305%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for PP93305: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: BK24148
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK24148%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for BK24148: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: YA45169
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA45169%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for YA45169: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: RK45787
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK45787%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for RK45787: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: CE82736
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE82736%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for CE82736: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: AE24734
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: AC91156
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC91156%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for AC91156: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: FH72535
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: PX22333
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX22333%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for PX22333: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: BH69278
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH69278%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for BH69278: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: CR04544
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR04544%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for CR04544: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: DS93846
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: AF99504
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF99504%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for AF99504: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: KL41152
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL41152%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for KL41152: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: YE09930
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE09930%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for YE09930: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: XB61397
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: CV87260
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: LX51563
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX51563%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [auto1.es] INFO: Scrape type for LX51563: 0
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: ZW73484
2026-03-28 11:02:30 [auto1.es] INFO: Found listing with ID: FG12610
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG12610%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for FG12610: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: TY35729
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY35729%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for TY35729: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: BV26369
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: TN84578
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN84578%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for TN84578: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: SC59966
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: EF44253
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: XD15291
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: NT29011
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT29011%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for NT29011: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: TW93253
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW93253%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for TW93253: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: ZR33369
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR33369%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for ZR33369: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: WC19502
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: UP08407
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: TD30983
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD30983%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for TD30983: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: SH43107
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: KV39877
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: YN87603
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN87603%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for YN87603: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: TT78731
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: CD98275
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD98275%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [auto1.es] INFO: Scrape type for CD98275: 0
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: DC35826
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: JN26439
2026-03-28 11:02:31 [auto1.es] INFO: Found listing with ID: YS21780
2026-03-28 11:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:32 [auto1.es] INFO: Channel: 24h | Page: 31 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: BG05674
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: DH23772
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH23772%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for DH23772: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: HH68332
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH68332%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for HH68332: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: EH02657
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH02657%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for EH02657: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: ME41297
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: BW06558
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW06558%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for BW06558: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: LC05327
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC05327%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for LC05327: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: NV73082
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: MA08789
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: VC32257
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: XH30785
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: RL96289
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL96289%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for RL96289: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: WB94881
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: BS00293
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BS00293%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for BS00293: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: MR84448
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: ET53098
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET53098%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for ET53098: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: FA94127
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: YP93952
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP93952%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for YP93952: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: FB20792
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB20792%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for FB20792: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: HZ26587
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: RH85625
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: DG40190
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG40190%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for DG40190: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: MP04292
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: LJ64414
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ64414%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for LJ64414: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: YW02554
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: RR71682
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR71682%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for RR71682: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: WY33726
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: AR59073
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: NH73319
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH73319%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for NH73319: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: MV76420
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: TZ42213
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ42213%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for TZ42213: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: MA84687
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: TY81479
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY81479%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for TY81479: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: NL32920
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NL32920%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for NL32920: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: HL39596
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: VT03580
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT03580%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for VT03580: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: AS19038
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS19038%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for AS19038: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: BY33283
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY33283%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.es] INFO: Scrape type for BY33283: 0
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: JF88454
2026-03-28 11:02:32 [auto1.es] INFO: Found listing with ID: EZ85260
2026-03-28 11:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:33 [auto1.es] INFO: Channel: 24h | Page: 32 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: RM57308
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: UF70444
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF70444%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for UF70444: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: PL43950
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: KL28800
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: TZ81028
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ81028%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for TZ81028: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: NB98056
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB98056%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for NB98056: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: GR21814
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: GK19760
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK19760%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for GK19760: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: KU93995
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: CH33556
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH33556%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for CH33556: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: RX23320
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX23320%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for RX23320: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: PJ00608
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PJ00608%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for PJ00608: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: LU54456
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: EX28567
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: RA35463
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA35463%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for RA35463: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: CV55647
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV55647%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [auto1.es] INFO: Scrape type for CV55647: 0
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: PA43540
2026-03-28 11:02:33 [auto1.es] INFO: Found listing with ID: KW12372
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW12372%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for KW12372: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: XT42288
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT42288%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for XT42288: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: HA98182
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: VY50847
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: TS51738
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS51738%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for TS51738: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: JA52917
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: KK03288
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK03288%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for KK03288: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: NX72938
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: WM80180
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM80180%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for WM80180: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: FM79545
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: UR77276
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: FG51952
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: BR63324
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: LV60077
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV60077%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for LV60077: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: VL50797
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: SW23101
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW23101%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for SW23101: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: TF28365
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF28365%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for TF28365: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: FB55193
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: NM57742
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM57742%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for NM57742: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: BS14602
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: SZ63984
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ63984%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for SZ63984: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: XU33886
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU33886%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [auto1.es] INFO: Scrape type for XU33886: 0
2026-03-28 11:02:34 [auto1.es] INFO: Found listing with ID: FD79630
2026-03-28 11:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:35 [auto1.es] INFO: Channel: 24h | Page: 33 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: NV08430
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV08430%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for NV08430: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ES89527
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ZL78219
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL78219%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for ZL78219: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: KE44681
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE44681%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for KE44681: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: XY74308
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY74308%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for XY74308: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: JN45905
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JN45905%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for JN45905: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: MT58185
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58185%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for MT58185: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: XZ34869
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ34869%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for XZ34869: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: DW24133
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW24133%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for DW24133: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: SG11403
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG11403%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for SG11403: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: BR35184
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR35184%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for BR35184: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: WD04556
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: UC81403
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC81403%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for UC81403: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: CG34681
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG34681%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for CG34681: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: UF24863
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF24863%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for UF24863: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: BZ30519
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: WW50429
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW50429%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for WW50429: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: LL75884
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL75884%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for LL75884: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ZB37818
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: DY77667
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY77667%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for DY77667: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: BB64860
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: XR73155
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR73155%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for XR73155: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: RZ31529
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ31529%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for RZ31529: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: EW95234
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW95234%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for EW95234: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ZS73380
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: YV96776
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: GA63026
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA63026%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for GA63026: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: VD82224
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD82224%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for VD82224: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ZT77590
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT77590%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for ZT77590: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: VF01083
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: UU89702
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU89702%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for UU89702: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: ZY52551
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: YF84144
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF84144%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for YF84144: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: EN42971
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: PD68374
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD68374%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for PD68374: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: UD71414
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: XR91515
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR91515%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for XR91515: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: KJ07748
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for KJ07748: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: AJ61664
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ61664%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for AJ61664: 0
2026-03-28 11:02:35 [auto1.es] INFO: Found listing with ID: RV91175
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV91175%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [auto1.es] INFO: Scrape type for RV91175: 0
2026-03-28 11:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:36 [auto1.es] INFO: Channel: 24h | Page: 34 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: NL36775
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: MA45744
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: FZ75347
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ75347%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for FZ75347: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: NT89177
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: ZC64345
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: FG54373
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG54373%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for FG54373: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: XD17912
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD17912%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for XD17912: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: RY22174
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: UT20809
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT20809%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for UT20809: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: FG10684
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: FU47680
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU47680%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for FU47680: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: CH09218
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: UF43058
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF43058%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for UF43058: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: TF80262
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF80262%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for TF80262: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: YT73159
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: TG66753
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG66753%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for TG66753: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: AU62151
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU62151%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for AU62151: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: CL10688
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: UT51740
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT51740%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for UT51740: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: XH62171
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH62171%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for XH62171: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: DH48682
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH48682%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [auto1.es] INFO: Scrape type for DH48682: 0
2026-03-28 11:02:36 [auto1.es] INFO: Found listing with ID: TU72670
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU72670%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for TU72670: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: CC38102
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: DT94982
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: GC28603
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: MC11095
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: NV62926
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV62926%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for NV62926: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: MA34031
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA34031%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for MA34031: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: KM76960
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: NK65007
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK65007%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for NK65007: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: TW71891
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: UD05464
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: DD26500
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD26500%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for DD26500: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: XP71478
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP71478%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for XP71478: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: ZZ54358
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ54358%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for ZZ54358: 0
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: BB78010
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: SP16189
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: LN74062
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: GT09019
2026-03-28 11:02:37 [auto1.es] INFO: Found listing with ID: FX97244
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX97244%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [auto1.es] INFO: Scrape type for FX97244: 0
2026-03-28 11:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:38 [auto1.es] INFO: Channel: 24h | Page: 35 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: SK09082
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: NY35082
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: CD12764
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CD12764%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for CD12764: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: JL56851
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: JF75670
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: ZY41152
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY41152%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for ZY41152: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: WT09242
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: FS30541
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS30541%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for FS30541: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: KS85396
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: GS63441
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS63441%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for GS63441: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: FB21971
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: AG10118
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG10118%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for AG10118: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: YM84351
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM84351%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for YM84351: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: EU03494
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: RF56388
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF56388%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for RF56388: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: XA81448
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: RL15311
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL15311%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for RL15311: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: AD59112
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: FL29872
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: NK77548
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK77548%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for NK77548: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: JH13002
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: VG51698
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG51698%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for VG51698: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: XZ20616
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: WF62317
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: CL39322
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL39322%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for CL39322: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: CU36803
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: KT28524
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT28524%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for KT28524: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: EX93255
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: SH77373
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH77373%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for SH77373: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: GM36563
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM36563%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for GM36563: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: XT63016
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: KD18831
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: UC02522
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC02522%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for UC02522: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: EV19134
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: UZ90788
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: FU34465
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: YA75501
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA75501%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for YA75501: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: XA87642
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA87642%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for XA87642: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: XZ11402
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ11402%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for XZ11402: 0
2026-03-28 11:02:38 [auto1.es] INFO: Found listing with ID: JV95856
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JV95856%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [auto1.es] INFO: Scrape type for JV95856: 0
2026-03-28 11:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:39 [auto1.es] INFO: Channel: 24h | Page: 36 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: XS50380
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: LC68552
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC68552%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for LC68552: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: CD34626
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: TV57362
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV57362%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for TV57362: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: BS42122
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: SM85087
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM85087%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for SM85087: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: LS40670
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: RC86632
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC86632%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for RC86632: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: RR39906
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: RU34223
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: GA97156
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: VW25923
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: YY21107
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: YM80761
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM80761%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for YM80761: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: HV14061
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV14061%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for HV14061: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: HR86968
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HR86968%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for HR86968: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: KP17570
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP17570%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for KP17570: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: ZW86524
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW86524%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for ZW86524: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: ZT59108
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: XX07827
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: CU53246
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: LR10742
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: VC56562
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: HB97411
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: ZS36669
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: NJ98715
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ98715%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for NJ98715: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: VY69585
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: FT04300
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT04300%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for FT04300: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: PS20422
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS20422%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for PS20422: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: KB11280
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: AC97398
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC97398%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for AC97398: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: FK13380
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: DD02893
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02893%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for DD02893: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: FJ48317
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: TB67105
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB67105%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for TB67105: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: YH79403
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH79403%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for YH79403: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: RJ57584
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: ZM86466
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM86466%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [auto1.es] INFO: Scrape type for ZM86466: 0
2026-03-28 11:02:39 [auto1.es] INFO: Found listing with ID: SK07271
2026-03-28 11:02:40 [auto1.es] INFO: Found listing with ID: WZ18115
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ18115%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [auto1.es] INFO: Scrape type for WZ18115: 0
2026-03-28 11:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:41 [auto1.es] INFO: Channel: 24h | Page: 37 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: CL69232
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL69232%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for CL69232: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: XZ49849
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: VK08624
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK08624%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for VK08624: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: ZF20558
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: LA59477
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA59477%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for LA59477: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: WT51875
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT51875%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for WT51875: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: YJ22618
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: CY21718
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY21718%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for CY21718: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: EN57511
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: MJ86771
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ86771%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for MJ86771: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: FG81749
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG81749%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for FG81749: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: XW98344
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW98344%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for XW98344: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: FA05952
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA05952%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for FA05952: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: HY26286
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: SL84888
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: CM92438
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: EG03635
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG03635%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for EG03635: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: EM05584
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM05584%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for EM05584: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: DR35066
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: ZT41669
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT41669%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for ZT41669: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: LB47883
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: ZH70186
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: BE54244
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: FM46706
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM46706%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for FM46706: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: RC07486
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC07486%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for RC07486: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: PU52271
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU52271%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for PU52271: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: JW04171
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: HF45963
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF45963%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for HF45963: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: UD26451
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UD26451%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for UD26451: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: YL57759
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL57759%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for YL57759: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: BY74928
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: AP77113
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: VW52839
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW52839%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for VW52839: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: UH68821
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: FJ96130
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ96130%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for FJ96130: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: MC49666
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MC49666%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for MC49666: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: RR74853
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR74853%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for RR74853: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: JJ77360
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: CY26712
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY26712%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for CY26712: 0
2026-03-28 11:02:41 [auto1.es] INFO: Found listing with ID: SR69249
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SR69249%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.es] INFO: Scrape type for SR69249: 0
2026-03-28 11:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:42 [auto1.es] INFO: Channel: 24h | Page: 38 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:42 [auto1.es] INFO: Found listing with ID: RG81713
2026-03-28 11:02:42 [auto1.es] INFO: Found listing with ID: NC65740
2026-03-28 11:02:42 [auto1.es] INFO: Found listing with ID: MP83522
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP83522%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for MP83522: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: ZV33545
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV33545%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for ZV33545: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: GL92788
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: XH10437
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: JN05964
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: KW20253
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: CG09187
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG09187%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for CG09187: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: ZL32724
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: YF74611
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: WC57455
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: YU51978
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: LY65055
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: NG74473
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG74473%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for NG74473: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: NF74888
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: DH03412
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH03412%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for DH03412: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: XR15363
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR15363%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for XR15363: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: JV83587
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: SN56696
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SN56696%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for SN56696: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: XV15787
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: FR40817
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: BU83574
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: HV80518
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV80518%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for HV80518: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: YP61713
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: SP65649
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP65649%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for SP65649: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: KP20621
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: NA52413
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: ZE77964
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: WA77291
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: EN05559
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN05559%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for EN05559: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: EU16511
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: PF18321
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: JC37021
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC37021%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for JC37021: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: YW59434
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW59434%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for YW59434: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: XW29028
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW29028%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for XW29028: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: ZF17550
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: DY05510
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY05510%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [auto1.es] INFO: Scrape type for DY05510: 0
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: YC76181
2026-03-28 11:02:43 [auto1.es] INFO: Found listing with ID: XH10383
2026-03-28 11:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:44 [auto1.es] INFO: Channel: 24h | Page: 39 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: SF23835
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: JZ74348
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JZ74348%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for JZ74348: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: EV57307
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV57307%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for EV57307: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: AP01935
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP01935%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for AP01935: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: HA51253
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA51253%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for HA51253: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: DB91286
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB91286%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for DB91286: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: US16617
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: UZ32916
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: KH58937
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: BB21726
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB21726%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for BB21726: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: VE25065
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: VC51874
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: HB80191
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB80191%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for HB80191: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: EH44076
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: BV69737
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV69737%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for BV69737: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: CE26517
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE26517%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for CE26517: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: WP31785
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP31785%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for WP31785: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: NA45690
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA45690%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for NA45690: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: XW07664
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: UL26650
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: PN60622
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: BE55826
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE55826%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for BE55826: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: MR13736
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR13736%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for MR13736: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: XY73701
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: NJ64367
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: MU84560
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU84560%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for MU84560: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: VZ14573
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14573%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for VZ14573: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: NP28736
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: BE57585
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE57585%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for BE57585: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: LZ46895
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ46895%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for LZ46895: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: ZK08967
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK08967%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for ZK08967: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: MF18812
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: VX73239
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: GS37711
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS37711%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for GS37711: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: MD97530
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD97530%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.es] INFO: Scrape type for MD97530: 0
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: HE26407
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: CH37145
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: YX91165
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: PM01444
2026-03-28 11:02:44 [auto1.es] INFO: Found listing with ID: CG97821
2026-03-28 11:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:45 [auto1.es] INFO: Channel: 24h | Page: 40 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: HU91100
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU91100%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.es] INFO: Scrape type for HU91100: 0
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: CP16982
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.es] INFO: Scrape type for CP16982: 0
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: SW39850
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW39850%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.es] INFO: Scrape type for SW39850: 0
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: ES67704
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: UF98716
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF98716%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.es] INFO: Scrape type for UF98716: 0
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: UV98686
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: ZL46614
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: CF72772
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: CD32787
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: ME11919
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME11919%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [auto1.es] INFO: Scrape type for ME11919: 0
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: YU32195
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: HE05235
2026-03-28 11:02:45 [auto1.es] INFO: Found listing with ID: GE49904
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE49904%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for GE49904: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: UX45403
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX45403%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for UX45403: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: PY10364
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: FY36073
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY36073%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for FY36073: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: HM53954
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM53954%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for HM53954: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: KE93313
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: GX93030
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: DS99682
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: WV40532
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: KC53673
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KC53673%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for KC53673: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: SM25064
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM25064%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for SM25064: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: MP42129
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: NK34270
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK34270%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for NK34270: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: US76988
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US76988%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for US76988: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: HL11989
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL11989%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for HL11989: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: UL24539
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL24539%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for UL24539: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: WE46909
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: XL66794
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL66794%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for XL66794: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: GJ58304
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: SU07288
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: RN04683
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: KE66826
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE66826%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for KE66826: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: GT62572
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: SA21904
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA21904%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [auto1.es] INFO: Scrape type for SA21904: 0
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: CU63126
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: PS40392
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: ER70032
2026-03-28 11:02:46 [auto1.es] INFO: Found listing with ID: NB66504
2026-03-28 11:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:47 [auto1.es] INFO: Channel: 24h | Page: 41 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: LY43971
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY43971%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for LY43971: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: AR16993
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: AE99486
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: ST64769
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST64769%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for ST64769: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: BR73846
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: NZ52735
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: VG19915
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG19915%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for VG19915: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: JX90216
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: WW69130
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: DB60699
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB60699%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for DB60699: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: MD84451
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD84451%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for MD84451: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: FF27063
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF27063%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for FF27063: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: FM76074
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: FN47664
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: PX56700
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: LE05631
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE05631%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for LE05631: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: YA92841
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA92841%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for YA92841: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: WJ47895
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: EN16009
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN16009%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for EN16009: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: BP83698
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP83698%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for BP83698: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: UY61522
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: FP96823
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: MT75330
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: CY83374
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: CA59744
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: GZ65139
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: SV82730
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: NR18889
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR18889%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for NR18889: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: GT34308
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: VE56967
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE56967%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for VE56967: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: YG49669
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG49669%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for YG49669: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: XX51310
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: NZ53366
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ53366%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for NZ53366: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: HA69691
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA69691%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for HA69691: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: BR02548
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR02548%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for BR02548: 0
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: CK45240
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: NT11654
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: FU44920
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: CH18424
2026-03-28 11:02:47 [auto1.es] INFO: Found listing with ID: KR74310
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR74310%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [auto1.es] INFO: Scrape type for KR74310: 0
2026-03-28 11:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:48 [auto1.es] INFO: Channel: 24h | Page: 42 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: HL87277
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: ZS52106
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS52106%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for ZS52106: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: GA48296
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: PV57289
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV57289%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for PV57289: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: DH51017
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: YS24805
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS24805%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for YS24805: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: KK62636
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK62636%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for KK62636: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: GP88698
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP88698%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for GP88698: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: UE51591
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE51591%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [auto1.es] INFO: Scrape type for UE51591: 0
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: KK88543
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: SJ54893
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: UR77549
2026-03-28 11:02:48 [auto1.es] INFO: Found listing with ID: RH13684
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH13684%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for RH13684: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: RR88978
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: VM33646
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM33646%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for VM33646: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: TN33358
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: JR18467
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: WH79046
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH79046%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for WH79046: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: YH97828
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: ZR58264
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for ZR58264: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: EG55234
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: JY61710
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: MZ20228
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: NF49332
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF49332%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for NF49332: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: GP02900
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP02900%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for GP02900: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: TJ92656
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: TJ35606
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: JL87579
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: CU50273
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: KA14000
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA14000%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for KA14000: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: LU77013
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU77013%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for LU77013: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: UN54067
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN54067%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for UN54067: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: EB66984
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: LE92322
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: FK94642
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: RF34421
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF34421%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for RF34421: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: MF83182
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF83182%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for MF83182: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: UJ15106
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ15106%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for UJ15106: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: SX47256
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX47256%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [auto1.es] INFO: Scrape type for SX47256: 0
2026-03-28 11:02:49 [auto1.es] INFO: Found listing with ID: TL38815
2026-03-28 11:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:50 [auto1.es] INFO: Channel: 24h | Page: 43 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: RT35335
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT35335%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for RT35335: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: AY17458
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY17458%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for AY17458: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: AX44077
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX44077%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for AX44077: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LR05195
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR05195%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for LR05195: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: ED43827
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED43827%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for ED43827: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: WE77493
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE77493%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for WE77493: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: TK05995
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: RE01082
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: VR51792
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: WW04715
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW04715%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for WW04715: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LP98864
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: CL84602
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: CB44972
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: GB72499
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB72499%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for GB72499: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: YG58121
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG58121%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for YG58121: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: CM66780
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM66780%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for CM66780: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: NJ18297
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: JP19484
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JP19484%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for JP19484: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: FL72079
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL72079%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for FL72079: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: CD37802
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: KR53631
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR53631%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for KR53631: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: RH73314
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: FM03469
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM03469%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for FM03469: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: DK97910
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: TZ12338
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ12338%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for TZ12338: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: UE32558
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: BL42593
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: VV22800
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV22800%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for VV22800: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: JT33139
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT33139%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for JT33139: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LV49477
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49477%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for LV49477: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: CM70741
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: SM51869
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: DU33012
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LN79000
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN79000%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for LN79000: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: PG51774
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PG51774%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for PG51774: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LA22899
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA22899%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for LA22899: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: LV62700
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: KT03520
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT03520%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for KT03520: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: PR26492
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR26492%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [auto1.es] INFO: Scrape type for PR26492: 0
2026-03-28 11:02:50 [auto1.es] INFO: Found listing with ID: MA61689
2026-03-28 11:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:51 [auto1.es] INFO: Channel: 24h | Page: 44 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: NG44542
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: FT82115
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: EK45789
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK45789%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for EK45789: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: UA81124
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA81124%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for UA81124: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: KZ85278
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ85278%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for KZ85278: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: NN86390
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN86390%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for NN86390: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: MD24315
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: ER91055
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: MT58726
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MT58726%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for MT58726: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: MX17134
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: RK31632
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: DH56387
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH56387%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for DH56387: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: JC23738
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: DF11976
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: PL96310
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL96310%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for PL96310: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: FK36826
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK36826%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for FK36826: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: EV43622
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV43622%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for EV43622: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: DR08098
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: VR55239
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: MA33029
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA33029%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for MA33029: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: CF71670
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF71670%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [auto1.es] INFO: Scrape type for CF71670: 0
2026-03-28 11:02:51 [auto1.es] INFO: Found listing with ID: JM46031
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM46031%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for JM46031: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: WL49874
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL49874%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for WL49874: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: UR06074
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: DU03691
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: BK29060
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: NC38723
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: GA23722
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA23722%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for GA23722: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: RE88096
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE88096%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for RE88096: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: UB92538
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: VW16333
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VW16333%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for VW16333: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: LW24131
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: JH23969
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: GU02949
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU02949%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for GU02949: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: AD94776
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD94776%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for AD94776: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: FY67843
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY67843%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for FY67843: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: CJ73946
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ73946%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [auto1.es] INFO: Scrape type for CJ73946: 0
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: HW14857
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: YP76490
2026-03-28 11:02:52 [auto1.es] INFO: Found listing with ID: KD88168
2026-03-28 11:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:53 [auto1.es] INFO: Channel: 24h | Page: 45 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: MJ15003
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: BX46671
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: XH33697
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH33697%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for XH33697: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: AK05110
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK05110%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for AK05110: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: KA10637
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA10637%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for KA10637: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: RK54634
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: YF73149
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: NM67545
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM67545%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for NM67545: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: FX35940
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: KA04822
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: YU55670
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU55670%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for YU55670: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: AR66930
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR66930%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for AR66930: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: MS70085
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS70085%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for MS70085: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: EY91693
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY91693%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for EY91693: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: SK48295
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: RD09772
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: DC98818
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC98818%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for DC98818: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: FG46245
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: ZC78414
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC78414%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for ZC78414: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: SV12911
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: SW56869
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: HB55085
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: KB02477
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB02477%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for KB02477: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: XY62505
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: VC51295
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC51295%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for VC51295: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: ZU80420
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: CX94622
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: CV01854
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for CV01854: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: NH75257
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: MC91810
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: XX41705
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: WC11174
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: TX02907
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX02907%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [auto1.es] INFO: Scrape type for TX02907: 0
2026-03-28 11:02:53 [auto1.es] INFO: Found listing with ID: GT49964
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT49964%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.es] INFO: Scrape type for GT49964: 0
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: RU11910
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: MR81111
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: AG64385
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG64385%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [auto1.es] INFO: Scrape type for AG64385: 0
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: DE89755
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: FD55064
2026-03-28 11:02:54 [auto1.es] INFO: Found listing with ID: ZZ21581
2026-03-28 11:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:55 [auto1.es] INFO: Channel: 24h | Page: 46 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: UN59874
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN59874%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for UN59874: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: TS70412
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS70412%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for TS70412: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: LB05915
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB05915%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for LB05915: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: GU38907
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: ZD47887
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: RX29075
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: DD64860
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD64860%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for DD64860: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: YC67276
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC67276%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for YC67276: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: BT53297
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: EY80222
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY80222%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for EY80222: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: GJ06814
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: YJ20703
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ20703%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for YJ20703: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: LF19420
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: RK37999
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: VB75549
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: YV46157
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV46157%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for YV46157: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: MK48449
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK48449%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for MK48449: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: XA71436
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XA71436%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for XA71436: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: VV60127
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: RD28906
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: YC39574
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: ET46210
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: WG59071
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for WG59071: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: TF20925
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: JG54829
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: AS80806
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS80806%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for AS80806: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: ZG70058
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: YH51023
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YH51023%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for YH51023: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: CJ84501
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CJ84501%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for CJ84501: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: ZT56570
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZT56570%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for ZT56570: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: XN30812
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XN30812%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for XN30812: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: HH76274
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH76274%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for HH76274: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: LJ17115
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ17115%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for LJ17115: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: FG05757
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: DB89419
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: LA57781
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: RD28331
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: KK99044
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK99044%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [auto1.es] INFO: Scrape type for KK99044: 0
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: TW26676
2026-03-28 11:02:55 [auto1.es] INFO: Found listing with ID: GP55698
2026-03-28 11:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:56 [auto1.es] INFO: Channel: 24h | Page: 47 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: RG56357
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG56357%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for RG56357: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: SW63270
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: FH92259
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: WN06367
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN06367%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for WN06367: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: HM29961
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM29961%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for HM29961: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: XC57294
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: EU98432
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: RY15229
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for RY15229: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: DW75083
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW75083%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for DW75083: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: RL87551
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL87551%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for RL87551: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: KN45266
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: EL62965
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: XG96540
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: AB25333
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB25333%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for AB25333: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: WG96659
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG96659%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for WG96659: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: JM59673
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: GL31739
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: ZB83445
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for ZB83445: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: EE09579
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE09579%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for EE09579: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: ZL80540
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: PY12516
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY12516%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for PY12516: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: ZY07880
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY07880%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for ZY07880: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: UG14230
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: WD56273
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD56273%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for WD56273: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: WJ13059
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: PB42278
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: GH53615
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for GH53615: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: TD30027
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: FA27463
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: MR66674
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MR66674%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for MR66674: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: FA20187
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: XB66018
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB66018%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for XB66018: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: ES48862
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: AN82065
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: AP65187
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP65187%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for AP65187: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: EZ05662
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: GR17806
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: PW69748
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: LM78815
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM78815%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [auto1.es] INFO: Scrape type for LM78815: 0
2026-03-28 11:02:56 [auto1.es] INFO: Found listing with ID: XP48517
2026-03-28 11:02:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:57 [auto1.es] INFO: Channel: 24h | Page: 48 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: DD74793
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: VF19120
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: NM32585
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: PY80888
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: RA61754
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA61754%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.es] INFO: Scrape type for RA61754: 0
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: TS18952
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.es] INFO: Scrape type for TS18952: 0
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: GG84553
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GG84553%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.es] INFO: Scrape type for GG84553: 0
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: VY77417
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY77417%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [auto1.es] INFO: Scrape type for VY77417: 0
2026-03-28 11:02:57 [auto1.es] INFO: Found listing with ID: LS36094
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LS36094%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for LS36094: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: YW75502
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW75502%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for YW75502: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: CR47918
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR47918%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for CR47918: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: HF65167
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF65167%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for HF65167: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: GG33729
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: RD19726
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for RD19726: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: FJ71193
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ71193%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for FJ71193: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: JX94297
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX94297%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for JX94297: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: RC43522
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC43522%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for RC43522: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: EH10088
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: FB98424
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB98424%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for FB98424: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: GA24285
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: EL53937
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: SL87514
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL87514%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for SL87514: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: MN81981
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for MN81981: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: RG01927
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG01927%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for RG01927: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: WE77223
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: SL38190
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: KT38971
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for KT38971: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: PW28611
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: LZ88229
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88229%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for LZ88229: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: YM10014
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM10014%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for YM10014: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: BM84951
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM84951%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for BM84951: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: FX21213
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: JG12549
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: HK65705
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: WN81450
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: TG06683
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG06683%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for TG06683: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: RK21190
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: AL55124
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL55124%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for AL55124: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: BX87783
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX87783%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for BX87783: 0
2026-03-28 11:02:58 [auto1.es] INFO: Found listing with ID: UN21453
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN21453%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [auto1.es] INFO: Scrape type for UN21453: 0
2026-03-28 11:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:59 [auto1.es] INFO: Channel: 24h | Page: 49 | totalHits: 2553 | hits on page: 40
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: KF67108
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: HN15529
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: WZ09714
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ09714%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for WZ09714: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: GT72542
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: NC85422
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC85422%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for NC85422: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: NG03443
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG03443%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for NG03443: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: ZM94527
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM94527%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for ZM94527: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: ZY05184
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY05184%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for ZY05184: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: XB60101
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB60101%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for XB60101: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: MD81888
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD81888%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for MD81888: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: DS53595
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: JK89410
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK89410%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for JK89410: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: KT73774
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: DN57812
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN57812%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for DN57812: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: GF25247
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: GY71785
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: RF22633
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF22633%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for RF22633: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: TB59452
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for TB59452: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: JG20309
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: LF34637
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: TA37328
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: KS63423
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: MW76524
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW76524%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for MW76524: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: SU90916
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: YJ60609
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ60609%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for YJ60609: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: TB20827
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB20827%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for TB20827: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: JR41621
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: RR11017
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: HC78450
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: VE86539
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE86539%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for VE86539: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: SB05981
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: GH64040
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: US21221
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US21221%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for US21221: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: SB85910
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: WZ08736
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: YH80645
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: FW08254
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW08254%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for FW08254: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: PK70837
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK70837%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for PK70837: 0
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: EG02791
2026-03-28 11:02:59 [auto1.es] INFO: Found listing with ID: DF32061
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF32061%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [auto1.es] INFO: Scrape type for DF32061: 0
2026-03-28 11:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:00 [auto1.es] INFO: Channel: 24h | Page: 50 | totalHits: 2553 | hits on page: 40
2026-03-28 11:03:00 [auto1.es] INFO: Found listing with ID: JA56838
2026-03-28 11:03:00 [auto1.es] INFO: Found listing with ID: ZH85985
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH85985%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for ZH85985: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: YD78878
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD78878%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for YD78878: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: BB57842
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB57842%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for BB57842: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: FP11877
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP11877%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for FP11877: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: XS07722
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: SM50481
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: AM60182
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: WR08352
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR08352%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for WR08352: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: GY73641
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY73641%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for GY73641: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: LB26536
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LB26536%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for LB26536: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: FE19310
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: XB79448
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB79448%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for XB79448: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: ME14626
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME14626%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for ME14626: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: HS01643
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: CF60022
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: TP19820
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for TP19820: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: UP13396
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: HF43157
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HF43157%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for HF43157: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: RD87944
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD87944%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for RD87944: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: CV42273
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV42273%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for CV42273: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: LV56361
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: TW64158
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: KU36165
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: FG19732
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: BP57031
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for BP57031: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: RY21508
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY21508%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for RY21508: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: FV98550
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: NN72545
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN72545%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for NN72545: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: PX05110
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX05110%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for PX05110: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: VK69645
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK69645%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for VK69645: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: MV52589
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: YT36266
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: BM28897
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM28897%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for BM28897: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: YJ05760
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ05760%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for YJ05760: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: PH65326
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH65326%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for PH65326: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: ED82323
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED82323%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for ED82323: 0
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: YF71759
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: HJ36466
2026-03-28 11:03:01 [auto1.es] INFO: Found listing with ID: AC34566
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC34566%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.es] INFO: Scrape type for AC34566: 0
2026-03-28 11:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:02 [auto1.es] INFO: Channel: 24h | Page: 51 | totalHits: 2553 | hits on page: 40
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: SV63508
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: XR63585
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: FM92662
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: LG55317
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: DY55894
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: LN78930
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN78930%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for LN78930: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: EZ26896
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: WA45592
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA45592%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for WA45592: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: BG56736
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: KH43607
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: EE39278
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: XZ84742
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: BK86158
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: BU12450
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: UB63669
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: NP13134
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: ES80363
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES80363%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for ES80363: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: NA66808
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: GH55887
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: LL24572
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL24572%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for LL24572: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: WA42706
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA42706%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for WA42706: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: UJ02953
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: ZZ48834
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: VJ40506
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: RN82930
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN82930%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for RN82930: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: GZ65389
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65389%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for GZ65389: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: WU84058
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: ZN70323
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: JD05776
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: ZT28887
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: KF15980
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: XH14423
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: BK45760
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK45760%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for BK45760: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: BM13295
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM13295%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for BM13295: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: TR57503
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: XW97577
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW97577%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for XW97577: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: PF88217
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF88217%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for PF88217: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: MB16167
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB16167%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for MB16167: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: EG85848
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG85848%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.es] INFO: Scrape type for EG85848: 0
2026-03-28 11:03:02 [auto1.es] INFO: Found listing with ID: UZ66881
2026-03-28 11:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:03 [auto1.es] INFO: Channel: 24h | Page: 52 | totalHits: 2553 | hits on page: 40
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: BL63813
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: EN12947
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: TU33340
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU33340%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for TU33340: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: DV32133
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV32133%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for DV32133: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: ZV69106
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV69106%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for ZV69106: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: MD70003
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MD70003%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for MD70003: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: LA48157
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA48157%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for LA48157: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: EP39863
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP39863%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for EP39863: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: WW33252
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: GK53380
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: GX06456
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX06456%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for GX06456: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: MV28926
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MV28926%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for MV28926: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: HZ84403
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: SN85132
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: PZ83937
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: MJ22507
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for MJ22507: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: WA67007
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA67007%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for WA67007: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: AX74159
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX74159%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for AX74159: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: SL25416
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: GG82225
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: LV49535
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for LV49535: 0
2026-03-28 11:03:03 [auto1.es] INFO: Found listing with ID: DJ04712
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ04712%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.es] INFO: Scrape type for DJ04712: 2
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c0b21b-0b12-5801-afee-514550d3d6cf with identifier: DJ04712
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c0b21b-0b12-5801-afee-514550d3d6cf with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10c0b21b-0b12-5801-afee-514550d3d6cf with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10c0b21b-0b12-5801-afee-514550d3d6cf, identifier: DJ04712
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10c0b21b-0b12-5801-afee-514550d3d6cf with identifier: DJ04712
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10c0b21b-0b12-5801-afee-514550d3d6cf with identifier: DJ04712
2026-03-28 11:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10c0b21b-0b12-5801-afee-514550d3d6cf with identifier: DJ04712 to the API
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:13Z',
 'fuel_type': 'diesel',
 'id': '10c0b21b-0b12-5801-afee-514550d3d6cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ04712',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 170994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Trend Edition',
 'transmission': 'manual',
 'trim': 'Trend Edition',
 'year': 2020}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ04712%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.es] INFO: Saving data for DJ04712: {'auction_closing_time': 1774714513.0, 'created_time': 1774382515.187598, 'last_price_update_time': 1774695784.692558}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DJ04712') HTTP/1.1" 204 0
2026-03-28 11:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:04 [auto1.es] INFO: Found listing with ID: GX78430
2026-03-28 11:03:04 [auto1.es] INFO: Found listing with ID: XA13214
2026-03-28 11:03:04 [auto1.es] INFO: Found listing with ID: XH50909
2026-03-28 11:03:04 [auto1.es] INFO: Found listing with ID: DE67964
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE67964%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.es] INFO: Scrape type for DE67964: 2
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c23bd0-5bd9-5088-be78-a080623a54db with identifier: DE67964
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c23bd0-5bd9-5088-be78-a080623a54db with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c23bd0-5bd9-5088-be78-a080623a54db with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 07c23bd0-5bd9-5088-be78-a080623a54db, identifier: DE67964
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 07c23bd0-5bd9-5088-be78-a080623a54db with identifier: DE67964
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 07c23bd0-5bd9-5088-be78-a080623a54db with identifier: DE67964
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 07c23bd0-5bd9-5088-be78-a080623a54db with identifier: DE67964 to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'diesel',
 'id': '07c23bd0-5bd9-5088-be78-a080623a54db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE67964',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 95594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-02',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2021}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE67964%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.es] INFO: Saving data for DE67964: {'auction_closing_time': 1774715307.0, 'created_time': 1774361360.234325, 'last_price_update_time': 1774695785.169137}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE67964') HTTP/1.1" 204 0
2026-03-28 11:03:05 [auto1.es] INFO: Found listing with ID: TX42049
2026-03-28 11:03:05 [auto1.es] INFO: Found listing with ID: SG65714
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.es] INFO: Scrape type for SG65714: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9, identifier: SG65714
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714 to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:22:55Z',
 'fuel_type': 'diesel',
 'id': '58de18c2-29a4-5f4a-9961-b57bc5e43cd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG65714',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 119252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.es] INFO: Saving data for SG65714: {'auction_closing_time': 1774714975.0, 'created_time': 1773146826.488161, 'last_price_update_time': 1774695785.644411}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG65714') HTTP/1.1" 204 0
2026-03-28 11:03:05 [auto1.es] INFO: Found listing with ID: XJ18059
2026-03-28 11:03:05 [auto1.es] INFO: Found listing with ID: CY15368
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY15368%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [auto1.es] INFO: Scrape type for CY15368: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with identifier: CY15368
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8c552dd9-a2cd-57d0-856e-7b0d886ac080, identifier: CY15368
2026-03-28 11:03:05 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 30 pages/min), scraped 77 items (at 3 items/min)
2026-03-28 11:03:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with identifier: CY15368
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with identifier: CY15368
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8c552dd9-a2cd-57d0-856e-7b0d886ac080 with identifier: CY15368 to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:31Z',
 'fuel_type': 'diesel',
 'id': '8c552dd9-a2cd-57d0-856e-7b0d886ac080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY15368',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 154409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY15368%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Saving data for CY15368: {'auction_closing_time': 1774713871.0, 'created_time': 1773691534.789147, 'last_price_update_time': 1774695786.050797}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CY15368') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: UP27315
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: JG12289
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: RX15442
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX15442%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Scrape type for RX15442: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7502f183-80ca-5864-bfe3-132566d103db with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7502f183-80ca-5864-bfe3-132566d103db with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7502f183-80ca-5864-bfe3-132566d103db, identifier: RX15442
2026-03-28 11:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-28 11:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442
2026-03-28 11:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7502f183-80ca-5864-bfe3-132566d103db with identifier: RX15442 to the API
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:00Z',
 'fuel_type': 'petrol',
 'id': '7502f183-80ca-5864-bfe3-132566d103db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX15442',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 21186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-25',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.5 TGDI Mild-Hybrid GT-Line",
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2025}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX15442%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Saving data for RX15442: {'auction_closing_time': 1774716480.0, 'created_time': 1773131949.432402, 'last_price_update_time': 1774695786.478981}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RX15442') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: HT69965
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT69965%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Scrape type for HT69965: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a289fe43-d320-5751-96de-a91a1ca7ad0f with identifier: HT69965
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a289fe43-d320-5751-96de-a91a1ca7ad0f with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a289fe43-d320-5751-96de-a91a1ca7ad0f with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a289fe43-d320-5751-96de-a91a1ca7ad0f, identifier: HT69965
2026-03-28 11:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a289fe43-d320-5751-96de-a91a1ca7ad0f with identifier: HT69965
2026-03-28 11:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a289fe43-d320-5751-96de-a91a1ca7ad0f with identifier: HT69965
2026-03-28 11:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a289fe43-d320-5751-96de-a91a1ca7ad0f with identifier: HT69965 to the API
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:31Z',
 'fuel_type': 'diesel',
 'id': 'a289fe43-d320-5751-96de-a91a1ca7ad0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT69965',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 212524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT69965%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Saving data for HT69965: {'auction_closing_time': 1774716571.0, 'created_time': 1773691507.906202, 'last_price_update_time': 1774695786.955826}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT69965') HTTP/1.1" 204 0
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: KW14097
2026-03-28 11:03:06 [auto1.es] INFO: Found listing with ID: TE55978
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE55978%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.es] INFO: Scrape type for TE55978: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00c15c22-6912-5a8b-9272-739f1175edd7 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00c15c22-6912-5a8b-9272-739f1175edd7 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00c15c22-6912-5a8b-9272-739f1175edd7, identifier: TE55978
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978
2026-03-28 11:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00c15c22-6912-5a8b-9272-739f1175edd7 with identifier: TE55978 to the API
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:34Z',
 'fuel_type': 'diesel',
 'id': '00c15c22-6912-5a8b-9272-739f1175edd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE55978',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 149738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE55978%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.es] INFO: Saving data for TE55978: {'auction_closing_time': 1774717114.0, 'created_time': 1773131942.571228, 'last_price_update_time': 1774695787.354599}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TE55978') HTTP/1.1" 204 0
2026-03-28 11:03:07 [auto1.es] INFO: Found listing with ID: DG64903
2026-03-28 11:03:07 [auto1.es] INFO: Found listing with ID: YE59618
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE59618%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.es] INFO: Scrape type for YE59618: 2
2026-03-28 11:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-28 11:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2003a025-b00c-5bf6-a204-5119b3de4890 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2003a025-b00c-5bf6-a204-5119b3de4890 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2003a025-b00c-5bf6-a204-5119b3de4890, identifier: YE59618
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618
2026-03-28 11:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2003a025-b00c-5bf6-a204-5119b3de4890 with identifier: YE59618 to the API
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:32Z',
 'fuel_type': 'diesel',
 'id': '2003a025-b00c-5bf6-a204-5119b3de4890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE59618',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 141186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
 'transmission': 'automatic',
 'trim': 'SoChic',
 'year': 2021}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE59618%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.es] INFO: Saving data for YE59618: {'auction_closing_time': 1774713812.0, 'created_time': 1773131105.057342, 'last_price_update_time': 1774695787.762775}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YE59618') HTTP/1.1" 204 0
2026-03-28 11:03:07 [auto1.es] INFO: Found listing with ID: FJ48335
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48335%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.es] INFO: Scrape type for FJ48335: 2
2026-03-28 11:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 377ded3a-8966-5914-af19-f4bba4dc3e16 with identifier: FJ48335
2026-03-28 11:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 377ded3a-8966-5914-af19-f4bba4dc3e16 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 377ded3a-8966-5914-af19-f4bba4dc3e16 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 377ded3a-8966-5914-af19-f4bba4dc3e16, identifier: FJ48335
2026-03-28 11:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 377ded3a-8966-5914-af19-f4bba4dc3e16 with identifier: FJ48335
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 377ded3a-8966-5914-af19-f4bba4dc3e16 with identifier: FJ48335
2026-03-28 11:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 377ded3a-8966-5914-af19-f4bba4dc3e16 with identifier: FJ48335 to the API
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:32Z',
 'fuel_type': 'diesel',
 'id': '377ded3a-8966-5914-af19-f4bba4dc3e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ48335',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 222158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2016}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ48335%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [auto1.es] INFO: Saving data for FJ48335: {'auction_closing_time': 1774714532.0, 'created_time': 1774609273.884889, 'last_price_update_time': 1774695788.173552}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ48335') HTTP/1.1" 204 0
2026-03-28 11:03:08 [auto1.es] INFO: Found listing with ID: YP50704
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP50704%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [auto1.es] INFO: Scrape type for YP50704: 2
2026-03-28 11:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-28 11:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352bd981-e786-5639-a6eb-43e1869b72ae with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352bd981-e786-5639-a6eb-43e1869b72ae with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 352bd981-e786-5639-a6eb-43e1869b72ae, identifier: YP50704
2026-03-28 11:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-28 11:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704
2026-03-28 11:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 352bd981-e786-5639-a6eb-43e1869b72ae with identifier: YP50704 to the API
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:38:56Z',
 'fuel_type': 'hybrid',
 'id': '352bd981-e786-5639-a6eb-43e1869b72ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50704',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 19940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP50704%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [auto1.es] INFO: Saving data for YP50704: {'auction_closing_time': 1774715936.0, 'created_time': 1773132157.132613, 'last_price_update_time': 1774695788.592272}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP50704') HTTP/1.1" 204 0
2026-03-28 11:03:08 [auto1.es] INFO: Channel: 24h | Page: 53 | totalHits: 2553 | hits on page: 40
2026-03-28 11:03:08 [auto1.es] INFO: Found listing with ID: ML86623
2026-03-28 11:03:08 [auto1.es] INFO: Found listing with ID: AE33071
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE33071%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [auto1.es] INFO: Scrape type for AE33071: 2
2026-03-28 11:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-28 11:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2, identifier: AE33071
2026-03-28 11:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-28 11:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071
2026-03-28 11:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2 with identifier: AE33071 to the API
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:30:22Z',
 'fuel_type': 'hybrid',
 'id': 'c42b521a-c9fe-56a3-a430-dcd4e3ed3cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE33071',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 39644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE33071%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [auto1.es] INFO: Saving data for AE33071: {'auction_closing_time': 1774715422.0, 'created_time': 1773131254.444794, 'last_price_update_time': 1774695789.053438}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE33071') HTTP/1.1" 204 0
2026-03-28 11:03:09 [auto1.es] INFO: Found listing with ID: EY16008
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY16008%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [auto1.es] INFO: Scrape type for EY16008: 2
2026-03-28 11:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-28 11:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95ff564-e909-5d09-b7c7-50a8f59c61a6 with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95ff564-e909-5d09-b7c7-50a8f59c61a6 with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e95ff564-e909-5d09-b7c7-50a8f59c61a6, identifier: EY16008
2026-03-28 11:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-28 11:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008
2026-03-28 11:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e95ff564-e909-5d09-b7c7-50a8f59c61a6 with identifier: EY16008 to the API
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:58:14Z',
 'fuel_type': 'hybrid',
 'id': 'e95ff564-e909-5d09-b7c7-50a8f59c61a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY16008',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 116479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-10',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x2 Ligne Noire',
 'transmission': 'automatic',
 'trim': '4x2 Ligne Noire',
 'year': 2022}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY16008%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [auto1.es] INFO: Saving data for EY16008: {'auction_closing_time': 1774717094.0, 'created_time': 1773131213.87213, 'last_price_update_time': 1774695789.556834}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY16008') HTTP/1.1" 204 0
2026-03-28 11:03:09 [auto1.es] INFO: Found listing with ID: WB62155
2026-03-28 11:03:09 [auto1.es] INFO: Found listing with ID: XZ16571
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [auto1.es] INFO: Scrape type for XZ16571: 2
2026-03-28 11:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-03-28 11:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e54af9e9-ef54-5f37-8f1f-025919b039be with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e54af9e9-ef54-5f37-8f1f-025919b039be with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e54af9e9-ef54-5f37-8f1f-025919b039be, identifier: XZ16571
2026-03-28 11:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-03-28 11:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-03-28 11:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571 to the API
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:55:27Z',
 'fuel_type': 'diesel',
 'id': 'e54af9e9-ef54-5f37-8f1f-025919b039be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ16571',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 56838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [auto1.es] INFO: Saving data for XZ16571: {'auction_closing_time': 1774716927.0, 'created_time': 1773691516.559464, 'last_price_update_time': 1774695790.153754}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ16571') HTTP/1.1" 204 0
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: BZ14545
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: SP81388
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: YL98507
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: UZ13447
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: KX02596
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX02596%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [auto1.es] INFO: Scrape type for KX02596: 2
2026-03-28 11:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-28 11:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9, identifier: KX02596
2026-03-28 11:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-28 11:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596
2026-03-28 11:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9 with identifier: KX02596 to the API
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:43:21Z',
 'fuel_type': 'petrol',
 'id': '92fa5b0a-5cf3-55cd-85cd-727c9fa92ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX02596',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS9',
 'odometer': 21626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seller_name': None,
 'title': 'DS Automobiles DS9 1.6 PureTech Rivoli +',
 'transmission': 'automatic',
 'trim': 'Rivoli +',
 'year': 2022}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX02596%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [auto1.es] INFO: Saving data for KX02596: {'auction_closing_time': 1774716201.0, 'created_time': 1773691539.173706, 'last_price_update_time': 1774695790.653414}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX02596') HTTP/1.1" 204 0
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: VC76613
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: FE56951
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: RD14633
2026-03-28 11:03:10 [auto1.es] INFO: Found listing with ID: GT51555
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT51555%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [auto1.es] INFO: Scrape type for GT51555: 2
2026-03-28 11:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5226a956-758f-5f91-a9f8-8f35c726ec88 with identifier: GT51555
2026-03-28 11:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5226a956-758f-5f91-a9f8-8f35c726ec88 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5226a956-758f-5f91-a9f8-8f35c726ec88 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5226a956-758f-5f91-a9f8-8f35c726ec88, identifier: GT51555
2026-03-28 11:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5226a956-758f-5f91-a9f8-8f35c726ec88 with identifier: GT51555
2026-03-28 11:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5226a956-758f-5f91-a9f8-8f35c726ec88 with identifier: GT51555
2026-03-28 11:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5226a956-758f-5f91-a9f8-8f35c726ec88 with identifier: GT51555 to the API
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:32Z',
 'fuel_type': 'petrol',
 'id': '5226a956-758f-5f91-a9f8-8f35c726ec88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT51555',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 119641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-18',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2022}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT51555%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [auto1.es] INFO: Saving data for GT51555: {'auction_closing_time': 1774714712.0, 'created_time': 1773691527.988102, 'last_price_update_time': 1774695791.144384}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT51555') HTTP/1.1" 204 0
2026-03-28 11:03:11 [auto1.es] INFO: Found listing with ID: ZM80152
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM80152%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [auto1.es] INFO: Scrape type for ZM80152: 2
2026-03-28 11:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a493a6-3226-5b04-b712-eaabc4a969e4 with identifier: ZM80152
2026-03-28 11:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a493a6-3226-5b04-b712-eaabc4a969e4 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a493a6-3226-5b04-b712-eaabc4a969e4 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53a493a6-3226-5b04-b712-eaabc4a969e4, identifier: ZM80152
2026-03-28 11:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53a493a6-3226-5b04-b712-eaabc4a969e4 with identifier: ZM80152
2026-03-28 11:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53a493a6-3226-5b04-b712-eaabc4a969e4 with identifier: ZM80152
2026-03-28 11:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53a493a6-3226-5b04-b712-eaabc4a969e4 with identifier: ZM80152 to the API
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'diesel',
 'id': '53a493a6-3226-5b04-b712-eaabc4a969e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM80152',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 177197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-20',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM80152%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [auto1.es] INFO: Saving data for ZM80152: {'auction_closing_time': 1774713779.0, 'created_time': 1774609277.672246, 'last_price_update_time': 1774695791.524797}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZM80152') HTTP/1.1" 204 0
2026-03-28 11:03:11 [auto1.es] INFO: Found listing with ID: FN90345
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN90345%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [auto1.es] INFO: Scrape type for FN90345: 2
2026-03-28 11:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-28 11:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 63566c54-c7d1-5f83-ad65-4988d95bdcb0, identifier: FN90345
2026-03-28 11:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-28 11:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345
2026-03-28 11:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 63566c54-c7d1-5f83-ad65-4988d95bdcb0 with identifier: FN90345 to the API
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:27:27Z',
 'fuel_type': 'petrol',
 'id': '63566c54-c7d1-5f83-ad65-4988d95bdcb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN90345',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 19230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-20',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN90345%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [auto1.es] INFO: Saving data for FN90345: {'auction_closing_time': 1774715247.0, 'created_time': 1773132182.687038, 'last_price_update_time': 1774695791.959633}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN90345') HTTP/1.1" 204 0
2026-03-28 11:03:12 [auto1.es] INFO: Found listing with ID: ZA28450
2026-03-28 11:03:12 [auto1.es] INFO: Found listing with ID: VV73300
2026-03-28 11:03:12 [auto1.es] INFO: Found listing with ID: AT54546
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT54546%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.es] INFO: Scrape type for AT54546: 2
2026-03-28 11:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-28 11:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a5d825-803b-59d6-ab73-cf6a0d358751 with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a5d825-803b-59d6-ab73-cf6a0d358751 with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1a5d825-803b-59d6-ab73-cf6a0d358751, identifier: AT54546
2026-03-28 11:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-28 11:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546
2026-03-28 11:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1a5d825-803b-59d6-ab73-cf6a0d358751 with identifier: AT54546 to the API
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:54Z',
 'fuel_type': 'petrol',
 'id': 'e1a5d825-803b-59d6-ab73-cf6a0d358751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT54546',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 38152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2023}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT54546%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.es] INFO: Saving data for AT54546: {'auction_closing_time': 1774716954.0, 'created_time': 1773132208.161203, 'last_price_update_time': 1774695792.451648}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT54546') HTTP/1.1" 204 0
2026-03-28 11:03:12 [auto1.es] INFO: Found listing with ID: PB23846
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.es] INFO: Scrape type for PB23846: 2
2026-03-28 11:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-03-28 11:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a34a06-dafc-550b-a299-de49e9c4be7a with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a34a06-dafc-550b-a299-de49e9c4be7a with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51a34a06-dafc-550b-a299-de49e9c4be7a, identifier: PB23846
2026-03-28 11:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-03-28 11:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-03-28 11:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846 to the API
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'petrol',
 'id': '51a34a06-dafc-550b-a299-de49e9c4be7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB23846',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 117373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-17',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2022}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.es] INFO: Saving data for PB23846: {'auction_closing_time': 1774716172.0, 'created_time': 1773691521.295647, 'last_price_update_time': 1774695792.946901}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PB23846') HTTP/1.1" 204 0
2026-03-28 11:03:12 [auto1.es] INFO: Found listing with ID: VN77018
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN77018%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.es] INFO: Scrape type for VN77018: 2
2026-03-28 11:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-28 11:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b89159-71ff-5b33-a7cc-6b3029f8e178 with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b89159-71ff-5b33-a7cc-6b3029f8e178 with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0b89159-71ff-5b33-a7cc-6b3029f8e178, identifier: VN77018
2026-03-28 11:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-28 11:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018
2026-03-28 11:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0b89159-71ff-5b33-a7cc-6b3029f8e178 with identifier: VN77018 to the API
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:25:11Z',
 'fuel_type': 'petrol',
 'id': 'b0b89159-71ff-5b33-a7cc-6b3029f8e178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN77018',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 49281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-10',
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Connected Chic',
 'transmission': 'manual',
 'trim': 'Connected Chic',
 'year': 2021}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN77018%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.es] INFO: Saving data for VN77018: {'auction_closing_time': 1774715111.0, 'created_time': 1773131685.681137, 'last_price_update_time': 1774695793.3695}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VN77018') HTTP/1.1" 204 0
2026-03-28 11:03:13 [auto1.es] INFO: Channel: 24h | Page: 54 | totalHits: 2553 | hits on page: 40
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: WG01714
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: TB50178
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: JK29035
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK29035%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.es] INFO: Scrape type for JK29035: 2
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with identifier: JK29035
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd, identifier: JK29035
2026-03-28 11:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with identifier: JK29035
2026-03-28 11:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with identifier: JK29035
2026-03-28 11:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd with identifier: JK29035 to the API
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:31:39Z',
 'fuel_type': 'diesel',
 'id': 'e4d3fa9e-b164-5c24-b8b5-ff32aefb91cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK29035',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 105913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2022}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK29035%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.es] INFO: Saving data for JK29035: {'auction_closing_time': 1774715499.0, 'created_time': 1774361313.832836, 'last_price_update_time': 1774695793.752531}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK29035') HTTP/1.1" 204 0
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: FJ32217
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: MU50158
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: LV83724
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV83724%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.es] INFO: Scrape type for LV83724: 2
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d904815-a853-5d4e-87a1-164ef2632f23 with identifier: LV83724
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d904815-a853-5d4e-87a1-164ef2632f23 with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d904815-a853-5d4e-87a1-164ef2632f23 with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d904815-a853-5d4e-87a1-164ef2632f23, identifier: LV83724
2026-03-28 11:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: VL72913
2026-03-28 11:03:13 [auto1.es] INFO: Found listing with ID: ZZ62546
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ62546%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.es] INFO: Scrape type for ZZ62546: 2
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4824771b-b5bb-579a-a9de-059053aaad90 with identifier: ZZ62546
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4824771b-b5bb-579a-a9de-059053aaad90 with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4824771b-b5bb-579a-a9de-059053aaad90 with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4824771b-b5bb-579a-a9de-059053aaad90, identifier: ZZ62546
2026-03-28 11:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d904815-a853-5d4e-87a1-164ef2632f23 with identifier: LV83724
2026-03-28 11:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d904815-a853-5d4e-87a1-164ef2632f23 with identifier: LV83724
2026-03-28 11:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d904815-a853-5d4e-87a1-164ef2632f23 with identifier: LV83724 to the API
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:21:11Z',
 'fuel_type': 'hybrid',
 'id': '0d904815-a853-5d4e-87a1-164ef2632f23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV83724',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 169072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2022}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV83724%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [auto1.es] INFO: Saving data for LV83724: {'auction_closing_time': 1774714871.0, 'created_time': 1774382773.782193, 'last_price_update_time': 1774695794.240228}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV83724') HTTP/1.1" 204 0
2026-03-28 11:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4824771b-b5bb-579a-a9de-059053aaad90 with identifier: ZZ62546
2026-03-28 11:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4824771b-b5bb-579a-a9de-059053aaad90 with identifier: ZZ62546
2026-03-28 11:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4824771b-b5bb-579a-a9de-059053aaad90 with identifier: ZZ62546 to the API
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:58:07Z',
 'fuel_type': 'diesel',
 'id': '4824771b-b5bb-579a-a9de-059053aaad90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ62546',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 32594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-18',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Essential 4x4',
 'transmission': 'manual',
 'trim': 'Essential 4x4',
 'year': 2021}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ62546%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [auto1.es] INFO: Saving data for ZZ62546: {'auction_closing_time': 1774717087.0, 'created_time': 1773130297.42437, 'last_price_update_time': 1774695794.637427}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ62546') HTTP/1.1" 204 0
2026-03-28 11:03:14 [auto1.es] INFO: Found listing with ID: KH40259
2026-03-28 11:03:14 [auto1.es] INFO: Found listing with ID: EF00810
2026-03-28 11:03:14 [auto1.es] INFO: Found listing with ID: CR96058
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR96058%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [auto1.es] INFO: Scrape type for CR96058: 2
2026-03-28 11:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e38c3b95-83fb-5fba-b397-d5a5129acdae with identifier: CR96058
2026-03-28 11:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e38c3b95-83fb-5fba-b397-d5a5129acdae with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e38c3b95-83fb-5fba-b397-d5a5129acdae with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e38c3b95-83fb-5fba-b397-d5a5129acdae, identifier: CR96058
2026-03-28 11:03:14 [auto1.es] INFO: Found listing with ID: XP57901
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP57901%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [auto1.es] INFO: Scrape type for XP57901: 2
2026-03-28 11:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fe58a8-8ffd-5194-bb10-3cd76162f256 with identifier: XP57901
2026-03-28 11:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07fe58a8-8ffd-5194-bb10-3cd76162f256 with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07fe58a8-8ffd-5194-bb10-3cd76162f256 with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 07fe58a8-8ffd-5194-bb10-3cd76162f256, identifier: XP57901
2026-03-28 11:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e38c3b95-83fb-5fba-b397-d5a5129acdae with identifier: CR96058
2026-03-28 11:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e38c3b95-83fb-5fba-b397-d5a5129acdae with identifier: CR96058
2026-03-28 11:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e38c3b95-83fb-5fba-b397-d5a5129acdae with identifier: CR96058 to the API
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:52:38Z',
 'fuel_type': 'diesel',
 'id': 'e38c3b95-83fb-5fba-b397-d5a5129acdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR96058',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 188823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2023}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR96058%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [auto1.es] INFO: Saving data for CR96058: {'auction_closing_time': 1774716758.0, 'created_time': 1774382772.69343, 'last_price_update_time': 1774695795.188674}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CR96058') HTTP/1.1" 204 0
2026-03-28 11:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 07fe58a8-8ffd-5194-bb10-3cd76162f256 with identifier: XP57901
2026-03-28 11:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 07fe58a8-8ffd-5194-bb10-3cd76162f256 with identifier: XP57901
2026-03-28 11:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 07fe58a8-8ffd-5194-bb10-3cd76162f256 with identifier: XP57901 to the API
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:19:16Z',
 'fuel_type': 'diesel',
 'id': '07fe58a8-8ffd-5194-bb10-3cd76162f256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP57901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 247810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-28',
 'seller_name': None,
 'title': 'Volkswagen Touareg 2.5 TDI R5',
 'transmission': 'automatic',
 'trim': 'R5',
 'year': 2005}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP57901%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [auto1.es] INFO: Saving data for XP57901: {'auction_closing_time': 1774714756.0, 'created_time': 1774609284.37766, 'last_price_update_time': 1774695795.465861}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP57901') HTTP/1.1" 204 0
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: NH80896
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH80896%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [auto1.es] INFO: Scrape type for NH80896: 2
2026-03-28 11:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with identifier: NH80896
2026-03-28 11:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203, identifier: NH80896
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: JW76352
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: AB11386
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: XR29035
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: YF06119
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: MC71487
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: LT61588
2026-03-28 11:03:15 [auto1.es] INFO: Found listing with ID: MP31569
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP31569%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [auto1.es] INFO: Scrape type for MP31569: 2
2026-03-28 11:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-03-28 11:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd, identifier: MP31569
2026-03-28 11:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with identifier: NH80896
2026-03-28 11:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with identifier: NH80896
2026-03-28 11:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15bf13e3-3cd4-5b33-baf3-cc67ae0fb203 with identifier: NH80896 to the API
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'diesel',
 'id': '15bf13e3-3cd4-5b33-baf3-cc67ae0fb203',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH80896',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 205079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Reference XM',
 'transmission': 'manual',
 'trim': 'Reference XM',
 'year': 2023}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NH80896%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [auto1.es] INFO: Saving data for NH80896: {'auction_closing_time': 1774714568.0, 'created_time': 1773126758.190875, 'last_price_update_time': 1774695795.970057}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NH80896') HTTP/1.1" 204 0
2026-03-28 11:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-03-28 11:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569
2026-03-28 11:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd with identifier: MP31569 to the API
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:37Z',
 'fuel_type': 'diesel',
 'id': 'f41a60ce-2cf8-5fdc-ab30-eb33b5da6bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP31569',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 316866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP31569%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [auto1.es] INFO: Saving data for MP31569: {'auction_closing_time': 1774714177.0, 'created_time': 1774036851.562999, 'last_price_update_time': 1774695796.338694}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP31569') HTTP/1.1" 204 0
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: JJ54433
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: PX76519
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: TJ03460
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: EE78385
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: RL54744
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: FL97062
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: PC36576
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC36576%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [auto1.es] INFO: Scrape type for PC36576: 2
2026-03-28 11:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with identifier: PC36576
2026-03-28 11:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with scrape type 2
2026-03-28 11:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with scrape type 2
2026-03-28 11:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6202fc9b-a51d-5adb-96c7-c8ee425b7767, identifier: PC36576
2026-03-28 11:03:16 [auto1.es] INFO: Found listing with ID: UL23725
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL23725%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [auto1.es] INFO: Scrape type for UL23725: 2
2026-03-28 11:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with identifier: UL23725
2026-03-28 11:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with scrape type 2
2026-03-28 11:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with scrape type 2
2026-03-28 11:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e, identifier: UL23725
2026-03-28 11:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with identifier: PC36576
2026-03-28 11:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with identifier: PC36576
2026-03-28 11:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6202fc9b-a51d-5adb-96c7-c8ee425b7767 with identifier: PC36576 to the API
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:46:12Z',
 'fuel_type': 'diesel',
 'id': '6202fc9b-a51d-5adb-96c7-c8ee425b7767',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC36576',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 194314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2015}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC36576%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [auto1.es] INFO: Saving data for PC36576: {'auction_closing_time': 1774716372.0, 'created_time': 1774609307.528448, 'last_price_update_time': 1774695796.855571}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC36576') HTTP/1.1" 204 0
2026-03-28 11:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with identifier: UL23725
2026-03-28 11:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with identifier: UL23725
2026-03-28 11:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13dae6eb-9ed7-532f-84c2-c662d8cc7f3e with identifier: UL23725 to the API
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:23:43Z',
 'fuel_type': 'diesel',
 'id': '13dae6eb-9ed7-532f-84c2-c662d8cc7f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL23725',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 173124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL23725%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.es] INFO: Saving data for UL23725: {'auction_closing_time': 1774715023.0, 'created_time': 1773127037.216022, 'last_price_update_time': 1774695797.153657}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UL23725') HTTP/1.1" 204 0
2026-03-28 11:03:17 [auto1.es] INFO: Found listing with ID: TG55276
2026-03-28 11:03:17 [auto1.es] INFO: Found listing with ID: VL76370
2026-03-28 11:03:17 [auto1.es] INFO: Found listing with ID: AN25119
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN25119%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.es] INFO: Scrape type for AN25119: 2
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with identifier: AN25119
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d0e25de-1a26-56da-9a4d-7d4908e3ec85, identifier: AN25119
2026-03-28 11:03:17 [auto1.es] INFO: Found listing with ID: YC43770
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43770%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.es] INFO: Scrape type for YC43770: 2
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with identifier: YC43770
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663, identifier: YC43770
2026-03-28 11:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with identifier: AN25119
2026-03-28 11:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with identifier: AN25119
2026-03-28 11:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d0e25de-1a26-56da-9a4d-7d4908e3ec85 with identifier: AN25119 to the API
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:18:10Z',
 'fuel_type': 'diesel',
 'id': '0d0e25de-1a26-56da-9a4d-7d4908e3ec85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN25119',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 91510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2018}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN25119%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.es] INFO: Saving data for AN25119: {'auction_closing_time': 1774714690.0, 'created_time': 1774609293.313215, 'last_price_update_time': 1774695797.744711}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AN25119') HTTP/1.1" 204 0
2026-03-28 11:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with identifier: YC43770
2026-03-28 11:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with identifier: YC43770
2026-03-28 11:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6dee4f44-0ee6-5eab-b2f9-05b5a4a16663 with identifier: YC43770 to the API
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:46:24Z',
 'fuel_type': 'diesel',
 'id': '6dee4f44-0ee6-5eab-b2f9-05b5a4a16663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC43770',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 125435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43770%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.es] INFO: Saving data for YC43770: {'auction_closing_time': 1774716384.0, 'created_time': 1773127070.886208, 'last_price_update_time': 1774695798.169125}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC43770') HTTP/1.1" 204 0
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: HL96316
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: NA14080
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA14080%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.es] INFO: Scrape type for NA14080: 2
2026-03-28 11:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da54cf3b-3651-572a-a659-3eca9672c47b with identifier: NA14080
2026-03-28 11:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da54cf3b-3651-572a-a659-3eca9672c47b with scrape type 2
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da54cf3b-3651-572a-a659-3eca9672c47b with scrape type 2
2026-03-28 11:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da54cf3b-3651-572a-a659-3eca9672c47b, identifier: NA14080
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: FZ62617
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: UZ90227
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: CT66486
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: TN50205
2026-03-28 11:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da54cf3b-3651-572a-a659-3eca9672c47b with identifier: NA14080
2026-03-28 11:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da54cf3b-3651-572a-a659-3eca9672c47b with identifier: NA14080
2026-03-28 11:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da54cf3b-3651-572a-a659-3eca9672c47b with identifier: NA14080 to the API
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'diesel',
 'id': 'da54cf3b-3651-572a-a659-3eca9672c47b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA14080',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 179024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA14080%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.es] INFO: Saving data for NA14080: {'auction_closing_time': 1774714809.0, 'created_time': 1774609267.994906, 'last_price_update_time': 1774695798.57084}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA14080') HTTP/1.1" 204 0
2026-03-28 11:03:18 [auto1.es] INFO: Found listing with ID: KD32086
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD32086%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.es] INFO: Scrape type for KD32086: 2
2026-03-28 11:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48834647-cad3-508b-baec-b2c5fc7d5d47 with identifier: KD32086
2026-03-28 11:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48834647-cad3-508b-baec-b2c5fc7d5d47 with scrape type 2
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48834647-cad3-508b-baec-b2c5fc7d5d47 with scrape type 2
2026-03-28 11:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 48834647-cad3-508b-baec-b2c5fc7d5d47, identifier: KD32086
2026-03-28 11:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 48834647-cad3-508b-baec-b2c5fc7d5d47 with identifier: KD32086
2026-03-28 11:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 48834647-cad3-508b-baec-b2c5fc7d5d47 with identifier: KD32086
2026-03-28 11:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 48834647-cad3-508b-baec-b2c5fc7d5d47 with identifier: KD32086 to the API
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:09:45Z',
 'fuel_type': 'diesel',
 'id': '48834647-cad3-508b-baec-b2c5fc7d5d47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD32086',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 169746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-30',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi Audace',
 'transmission': 'manual',
 'trim': 'Audace',
 'year': 2007}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD32086%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Saving data for KD32086: {'auction_closing_time': 1774714185.0, 'created_time': 1774609280.579339, 'last_price_update_time': 1774695799.023723}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD32086') HTTP/1.1" 204 0
2026-03-28 11:03:19 [auto1.es] INFO: Found listing with ID: JE90684
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE90684%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Scrape type for JE90684: 2
2026-03-28 11:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6993cb46-7bde-5f7f-9cae-d50f684463d3 with identifier: JE90684
2026-03-28 11:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6993cb46-7bde-5f7f-9cae-d50f684463d3 with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6993cb46-7bde-5f7f-9cae-d50f684463d3 with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6993cb46-7bde-5f7f-9cae-d50f684463d3, identifier: JE90684
2026-03-28 11:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6993cb46-7bde-5f7f-9cae-d50f684463d3 with identifier: JE90684
2026-03-28 11:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6993cb46-7bde-5f7f-9cae-d50f684463d3 with identifier: JE90684
2026-03-28 11:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6993cb46-7bde-5f7f-9cae-d50f684463d3 with identifier: JE90684 to the API
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:32Z',
 'fuel_type': 'petrol',
 'id': '6993cb46-7bde-5f7f-9cae-d50f684463d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE90684',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 67887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2017}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE90684%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Saving data for JE90684: {'auction_closing_time': 1774713932.0, 'created_time': 1774609267.278875, 'last_price_update_time': 1774695799.47723}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE90684') HTTP/1.1" 204 0
2026-03-28 11:03:19 [auto1.es] INFO: Found listing with ID: KL07706
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Scrape type for KL07706: 2
2026-03-28 11:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-03-28 11:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe23f78e-e93e-5abd-acd9-b51972e14759 with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe23f78e-e93e-5abd-acd9-b51972e14759 with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe23f78e-e93e-5abd-acd9-b51972e14759, identifier: KL07706
2026-03-28 11:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-03-28 11:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-03-28 11:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706 to the API
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:34Z',
 'fuel_type': 'diesel',
 'id': 'fe23f78e-e93e-5abd-acd9-b51972e14759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL07706',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 126768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Saving data for KL07706: {'auction_closing_time': 1774716034.0, 'created_time': 1773691539.570512, 'last_price_update_time': 1774695799.938824}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL07706') HTTP/1.1" 204 0
2026-03-28 11:03:19 [auto1.es] INFO: Found listing with ID: ZC57359
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC57359%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [auto1.es] INFO: Scrape type for ZC57359: 2
2026-03-28 11:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-28 11:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f80241-5385-570e-9086-fd1340c493ad with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f80241-5385-570e-9086-fd1340c493ad with scrape type 2
2026-03-28 11:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24f80241-5385-570e-9086-fd1340c493ad, identifier: ZC57359
2026-03-28 11:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-28 11:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359
2026-03-28 11:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24f80241-5385-570e-9086-fd1340c493ad with identifier: ZC57359 to the API
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:43:53Z',
 'fuel_type': 'diesel',
 'id': '24f80241-5385-570e-9086-fd1340c493ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC57359',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 64381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC57359%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [auto1.es] INFO: Saving data for ZC57359: {'auction_closing_time': 1774716233.0, 'created_time': 1773132446.475758, 'last_price_update_time': 1774695800.94922}
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC57359') HTTP/1.1" 204 0
2026-03-28 11:03:20 [auto1.es] INFO: Found listing with ID: LJ23140
2026-03-28 11:03:20 [auto1.es] INFO: Found listing with ID: CH50110
2026-03-28 11:03:20 [auto1.es] INFO: Found listing with ID: ET64130
2026-03-28 11:03:20 [auto1.es] INFO: Found listing with ID: WL07406
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL07406%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [auto1.es] INFO: Scrape type for WL07406: 2
2026-03-28 11:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-28 11:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d2f731-f012-595b-ad24-345806a8093a with scrape type 2
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d2f731-f012-595b-ad24-345806a8093a with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68d2f731-f012-595b-ad24-345806a8093a, identifier: WL07406
2026-03-28 11:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-28 11:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406
2026-03-28 11:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68d2f731-f012-595b-ad24-345806a8093a with identifier: WL07406 to the API
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:08:53Z',
 'fuel_type': 'diesel',
 'id': '68d2f731-f012-595b-ad24-345806a8093a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL07406',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 161126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
 'transmission': 'automatic',
 'trim': 'SoChic',
 'year': 2021}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL07406%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [auto1.es] INFO: Saving data for WL07406: {'auction_closing_time': 1774714133.0, 'created_time': 1773132159.544642, 'last_price_update_time': 1774695801.372529}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WL07406') HTTP/1.1" 204 0
2026-03-28 11:03:21 [auto1.es] INFO: Found listing with ID: JL80339
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL80339%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [auto1.es] INFO: Scrape type for JL80339: 2
2026-03-28 11:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-28 11:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 528709e4-2667-5b17-9c1b-d3ce9ce409d3, identifier: JL80339
2026-03-28 11:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-28 11:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339
2026-03-28 11:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 528709e4-2667-5b17-9c1b-d3ce9ce409d3 with identifier: JL80339 to the API
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:41:52Z',
 'fuel_type': 'diesel',
 'id': '528709e4-2667-5b17-9c1b-d3ce9ce409d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL80339',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 46424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JL80339%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [auto1.es] INFO: Saving data for JL80339: {'auction_closing_time': 1774716112.0, 'created_time': 1773131721.977985, 'last_price_update_time': 1774695801.876561}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JL80339') HTTP/1.1" 204 0
2026-03-28 11:03:21 [auto1.es] INFO: Found listing with ID: UP46325
2026-03-28 11:03:21 [auto1.es] INFO: Found listing with ID: MM77073
2026-03-28 11:03:21 [auto1.es] INFO: Found listing with ID: DV58619
2026-03-28 11:03:21 [auto1.es] INFO: Found listing with ID: MH58773
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH58773%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [auto1.es] INFO: Scrape type for MH58773: 2
2026-03-28 11:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738feeec-f266-564c-bf3e-702d2a0fc24c with identifier: MH58773
2026-03-28 11:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738feeec-f266-564c-bf3e-702d2a0fc24c with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738feeec-f266-564c-bf3e-702d2a0fc24c with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 738feeec-f266-564c-bf3e-702d2a0fc24c, identifier: MH58773
2026-03-28 11:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 738feeec-f266-564c-bf3e-702d2a0fc24c with identifier: MH58773
2026-03-28 11:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 738feeec-f266-564c-bf3e-702d2a0fc24c with identifier: MH58773
2026-03-28 11:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 738feeec-f266-564c-bf3e-702d2a0fc24c with identifier: MH58773 to the API
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:51:05Z',
 'fuel_type': 'diesel',
 'id': '738feeec-f266-564c-bf3e-702d2a0fc24c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH58773',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 158049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-25',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH58773%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.es] INFO: Saving data for MH58773: {'auction_closing_time': 1774716665.0, 'created_time': 1773691547.252996, 'last_price_update_time': 1774695802.267373}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MH58773') HTTP/1.1" 204 0
2026-03-28 11:03:22 [auto1.es] INFO: Found listing with ID: KE17366
2026-03-28 11:03:22 [auto1.es] INFO: Found listing with ID: WM54096
2026-03-28 11:03:22 [auto1.es] INFO: Found listing with ID: YX68233
2026-03-28 11:03:22 [auto1.es] INFO: Found listing with ID: FW39837
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW39837%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.es] INFO: Scrape type for FW39837: 2
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a677f1-3712-5c75-ab34-9e3212f7cad3 with identifier: FW39837
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a677f1-3712-5c75-ab34-9e3212f7cad3 with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a677f1-3712-5c75-ab34-9e3212f7cad3 with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2a677f1-3712-5c75-ab34-9e3212f7cad3, identifier: FW39837
2026-03-28 11:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2a677f1-3712-5c75-ab34-9e3212f7cad3 with identifier: FW39837
2026-03-28 11:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2a677f1-3712-5c75-ab34-9e3212f7cad3 with identifier: FW39837
2026-03-28 11:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c2a677f1-3712-5c75-ab34-9e3212f7cad3 with identifier: FW39837 to the API
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:07:02Z',
 'fuel_type': 'diesel',
 'id': 'c2a677f1-3712-5c75-ab34-9e3212f7cad3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW39837',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 194677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2020}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW39837%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.es] INFO: Saving data for FW39837: {'auction_closing_time': 1774714022.0, 'created_time': 1774382612.669096, 'last_price_update_time': 1774695802.661393}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FW39837') HTTP/1.1" 204 0
2026-03-28 11:03:22 [auto1.es] INFO: Found listing with ID: ES82633
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.es] INFO: Scrape type for ES82633: 2
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c632c815-29b3-5cc1-b847-9b16a709c21f with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c632c815-29b3-5cc1-b847-9b16a709c21f with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c632c815-29b3-5cc1-b847-9b16a709c21f, identifier: ES82633
2026-03-28 11:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-03-28 11:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-03-28 11:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633 to the API
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:13Z',
 'fuel_type': 'diesel',
 'id': 'c632c815-29b3-5cc1-b847-9b16a709c21f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES82633',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.es] INFO: Saving data for ES82633: {'auction_closing_time': 1774716253.0, 'created_time': 1773691517.870718, 'last_price_update_time': 1774695803.154556}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES82633') HTTP/1.1" 204 0
2026-03-28 11:03:23 [auto1.es] INFO: Found listing with ID: JW31558
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW31558%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.es] INFO: Scrape type for JW31558: 2
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac3d66a-8bae-52d3-9443-caaa77036dea with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac3d66a-8bae-52d3-9443-caaa77036dea with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dac3d66a-8bae-52d3-9443-caaa77036dea, identifier: JW31558
2026-03-28 11:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-28 11:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558
2026-03-28 11:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dac3d66a-8bae-52d3-9443-caaa77036dea with identifier: JW31558 to the API
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:56:15Z',
 'fuel_type': 'petrol',
 'id': 'dac3d66a-8bae-52d3-9443-caaa77036dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW31558',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4',
 'odometer': 17143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-25',
 'seller_name': None,
 'title': 'DS Automobiles DS4 1.2 PureTech Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2024}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW31558%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.es] INFO: Saving data for JW31558: {'auction_closing_time': 1774716975.0, 'created_time': 1774609312.60357, 'last_price_update_time': 1774695803.564911}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW31558') HTTP/1.1" 204 0
2026-03-28 11:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:23 [auto1.es] INFO: Found listing with ID: XW86216
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW86216%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.es] INFO: Scrape type for XW86216: 2
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38f66071-261e-50e0-a5c0-bff9915590ca with identifier: XW86216
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38f66071-261e-50e0-a5c0-bff9915590ca with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38f66071-261e-50e0-a5c0-bff9915590ca with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38f66071-261e-50e0-a5c0-bff9915590ca, identifier: XW86216
2026-03-28 11:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38f66071-261e-50e0-a5c0-bff9915590ca with identifier: XW86216
2026-03-28 11:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38f66071-261e-50e0-a5c0-bff9915590ca with identifier: XW86216
2026-03-28 11:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 38f66071-261e-50e0-a5c0-bff9915590ca with identifier: XW86216 to the API
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:15:11Z',
 'fuel_type': 'petrol',
 'id': '38f66071-261e-50e0-a5c0-bff9915590ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW86216',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 123990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2013}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW86216%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Saving data for XW86216: {'auction_closing_time': 1774714511.0, 'created_time': 1774609307.941902, 'last_price_update_time': 1774695804.041143}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW86216') HTTP/1.1" 204 0
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR14615%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Scrape type for ZR14615: 2
2026-03-28 11:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 718da682-bf47-5a44-b651-f7fd87c7c402 with identifier: ZR14615
2026-03-28 11:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718da682-bf47-5a44-b651-f7fd87c7c402 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 718da682-bf47-5a44-b651-f7fd87c7c402 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 718da682-bf47-5a44-b651-f7fd87c7c402, identifier: ZR14615
2026-03-28 11:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 718da682-bf47-5a44-b651-f7fd87c7c402 with identifier: ZR14615
2026-03-28 11:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 718da682-bf47-5a44-b651-f7fd87c7c402 with identifier: ZR14615
2026-03-28 11:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 718da682-bf47-5a44-b651-f7fd87c7c402 with identifier: ZR14615 to the API
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:06Z',
 'fuel_type': 'diesel',
 'id': '718da682-bf47-5a44-b651-f7fd87c7c402',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR14615',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 129175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Volvo S40 2.0 D3 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR14615%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Saving data for ZR14615: {'auction_closing_time': 1774716066.0, 'created_time': 1774609265.75787, 'last_price_update_time': 1774695804.47542}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR14615') HTTP/1.1" 204 0
2026-03-28 11:03:24 [auto1.es] INFO: Channel: 24h | Page: 55 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: ZR14615
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR14615%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Scrape type for ZR14615: 0
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: MG74318
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG74318%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Scrape type for MG74318: 2
2026-03-28 11:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2419abe-efdd-56bc-86c9-cbb68972a1c2 with identifier: MG74318
2026-03-28 11:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2419abe-efdd-56bc-86c9-cbb68972a1c2 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2419abe-efdd-56bc-86c9-cbb68972a1c2 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2419abe-efdd-56bc-86c9-cbb68972a1c2, identifier: MG74318
2026-03-28 11:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2419abe-efdd-56bc-86c9-cbb68972a1c2 with identifier: MG74318
2026-03-28 11:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2419abe-efdd-56bc-86c9-cbb68972a1c2 with identifier: MG74318
2026-03-28 11:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2419abe-efdd-56bc-86c9-cbb68972a1c2 with identifier: MG74318 to the API
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-28T16:13:32Z',
 'fuel_type': 'diesel',
 'id': 'd2419abe-efdd-56bc-86c9-cbb68972a1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG74318',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 173809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-28',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2010}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG74318%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Saving data for MG74318: {'auction_closing_time': 1774714412.0, 'created_time': 1774609262.502715, 'last_price_update_time': 1774695804.867088}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG74318') HTTP/1.1" 204 0
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: EB56604
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: EZ75681
2026-03-28 11:03:24 [auto1.es] INFO: Found listing with ID: YP54060
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP54060%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.es] INFO: Scrape type for YP54060: 2
2026-03-28 11:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with identifier: YP54060
2026-03-28 11:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4dc33aa3-4b0c-5c86-963e-1922219b76e1, identifier: YP54060
2026-03-28 11:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with identifier: YP54060
2026-03-28 11:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with identifier: YP54060
2026-03-28 11:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4dc33aa3-4b0c-5c86-963e-1922219b76e1 with identifier: YP54060 to the API
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:15:45Z',
 'fuel_type': 'petrol',
 'id': '4dc33aa3-4b0c-5c86-963e-1922219b76e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP54060',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 124638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-06',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YP54060%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [auto1.es] INFO: Saving data for YP54060: {'auction_closing_time': 1774714545.0, 'created_time': 1774609266.444463, 'last_price_update_time': 1774695805.239172}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YP54060') HTTP/1.1" 204 0
2026-03-28 11:03:25 [auto1.es] INFO: Found listing with ID: ZF52825
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF52825%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [auto1.es] INFO: Scrape type for ZF52825: 2
2026-03-28 11:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c60254-6d44-57f2-b634-373dba8f406b with identifier: ZF52825
2026-03-28 11:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c60254-6d44-57f2-b634-373dba8f406b with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c60254-6d44-57f2-b634-373dba8f406b with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 46c60254-6d44-57f2-b634-373dba8f406b, identifier: ZF52825
2026-03-28 11:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 46c60254-6d44-57f2-b634-373dba8f406b with identifier: ZF52825
2026-03-28 11:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 46c60254-6d44-57f2-b634-373dba8f406b with identifier: ZF52825
2026-03-28 11:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 46c60254-6d44-57f2-b634-373dba8f406b with identifier: ZF52825 to the API
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:52:07Z',
 'fuel_type': 'petrol',
 'id': '46c60254-6d44-57f2-b634-373dba8f406b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF52825',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Linea',
 'odometer': 88909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-08',
 'seller_name': None,
 'title': 'Fiat Linea 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF52825%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [auto1.es] INFO: Saving data for ZF52825: {'auction_closing_time': 1774716727.0, 'created_time': 1774609281.735566, 'last_price_update_time': 1774695805.63201}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF52825') HTTP/1.1" 204 0
2026-03-28 11:03:25 [auto1.es] INFO: Found listing with ID: FD92977
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD92977%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [auto1.es] INFO: Scrape type for FD92977: 2
2026-03-28 11:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b772ca-44b8-5f4e-a2db-d7b3827de099 with identifier: FD92977
2026-03-28 11:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b772ca-44b8-5f4e-a2db-d7b3827de099 with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b772ca-44b8-5f4e-a2db-d7b3827de099 with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71b772ca-44b8-5f4e-a2db-d7b3827de099, identifier: FD92977
2026-03-28 11:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71b772ca-44b8-5f4e-a2db-d7b3827de099 with identifier: FD92977
2026-03-28 11:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71b772ca-44b8-5f4e-a2db-d7b3827de099 with identifier: FD92977
2026-03-28 11:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71b772ca-44b8-5f4e-a2db-d7b3827de099 with identifier: FD92977 to the API
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:19Z',
 'fuel_type': 'diesel',
 'id': '71b772ca-44b8-5f4e-a2db-d7b3827de099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD92977',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 79880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD92977%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [auto1.es] INFO: Saving data for FD92977: {'auction_closing_time': 1774715599.0, 'created_time': 1774609378.674122, 'last_price_update_time': 1774695806.026435}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD92977') HTTP/1.1" 204 0
2026-03-28 11:03:26 [auto1.es] INFO: Found listing with ID: UT04175
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT04175%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [auto1.es] INFO: Scrape type for UT04175: 2
2026-03-28 11:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with identifier: UT04175
2026-03-28 11:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9, identifier: UT04175
2026-03-28 11:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with identifier: UT04175
2026-03-28 11:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with identifier: UT04175
2026-03-28 11:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9 with identifier: UT04175 to the API
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:54:20Z',
 'fuel_type': 'petrol',
 'id': '6dcf0c87-e4c7-5f5d-9128-8e7f952f8aa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04175',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 350 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT04175%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [auto1.es] INFO: Saving data for UT04175: {'auction_closing_time': 1774716860.0, 'created_time': 1773129606.70633, 'last_price_update_time': 1774695806.457605}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT04175') HTTP/1.1" 204 0
2026-03-28 11:03:26 [auto1.es] INFO: Found listing with ID: FJ63213
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ63213%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [auto1.es] INFO: Scrape type for FJ63213: 2
2026-03-28 11:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb54812-ef31-56e1-94a6-9326d44fa017 with identifier: FJ63213
2026-03-28 11:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb54812-ef31-56e1-94a6-9326d44fa017 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb54812-ef31-56e1-94a6-9326d44fa017 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3bb54812-ef31-56e1-94a6-9326d44fa017, identifier: FJ63213
2026-03-28 11:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3bb54812-ef31-56e1-94a6-9326d44fa017 with identifier: FJ63213
2026-03-28 11:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3bb54812-ef31-56e1-94a6-9326d44fa017 with identifier: FJ63213
2026-03-28 11:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3bb54812-ef31-56e1-94a6-9326d44fa017 with identifier: FJ63213 to the API
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:37:39Z',
 'fuel_type': 'diesel',
 'id': '3bb54812-ef31-56e1-94a6-9326d44fa017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ63213',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 139754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-20',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ63213%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [auto1.es] INFO: Saving data for FJ63213: {'auction_closing_time': 1774715859.0, 'created_time': 1774609373.836734, 'last_price_update_time': 1774695806.952413}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ63213') HTTP/1.1" 204 0
2026-03-28 11:03:27 [auto1.es] INFO: Found listing with ID: YM46867
2026-03-28 11:03:27 [auto1.es] INFO: Found listing with ID: DM27699
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM27699%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.es] INFO: Scrape type for DM27699: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88a2457-3e36-558b-8e73-f8d9adaaf78e with identifier: DM27699
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88a2457-3e36-558b-8e73-f8d9adaaf78e with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88a2457-3e36-558b-8e73-f8d9adaaf78e with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c88a2457-3e36-558b-8e73-f8d9adaaf78e, identifier: DM27699
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c88a2457-3e36-558b-8e73-f8d9adaaf78e with identifier: DM27699
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c88a2457-3e36-558b-8e73-f8d9adaaf78e with identifier: DM27699
2026-03-28 11:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c88a2457-3e36-558b-8e73-f8d9adaaf78e with identifier: DM27699 to the API
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:49:37Z',
 'fuel_type': 'petrol',
 'id': 'c88a2457-3e36-558b-8e73-f8d9adaaf78e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27699',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 110402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM27699%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.es] INFO: Saving data for DM27699: {'auction_closing_time': 1774716577.0, 'created_time': 1773931718.260331, 'last_price_update_time': 1774695807.437433}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM27699') HTTP/1.1" 204 0
2026-03-28 11:03:27 [auto1.es] INFO: Found listing with ID: FP35669
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP35669%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.es] INFO: Scrape type for FP35669: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b8a917-9099-5ff5-b807-ec2157c5c19a with identifier: FP35669
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b8a917-9099-5ff5-b807-ec2157c5c19a with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73b8a917-9099-5ff5-b807-ec2157c5c19a with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73b8a917-9099-5ff5-b807-ec2157c5c19a, identifier: FP35669
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73b8a917-9099-5ff5-b807-ec2157c5c19a with identifier: FP35669
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73b8a917-9099-5ff5-b807-ec2157c5c19a with identifier: FP35669
2026-03-28 11:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73b8a917-9099-5ff5-b807-ec2157c5c19a with identifier: FP35669 to the API
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:03:34Z',
 'fuel_type': 'petrol',
 'id': '73b8a917-9099-5ff5-b807-ec2157c5c19a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP35669',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 133573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ikon',
 'transmission': 'manual',
 'trim': 'Ikon',
 'year': 2011}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP35669%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.es] INFO: Saving data for FP35669: {'auction_closing_time': 1774713814.0, 'created_time': 1774609274.595426, 'last_price_update_time': 1774695807.853007}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP35669') HTTP/1.1" 204 0
2026-03-28 11:03:27 [auto1.es] INFO: Found listing with ID: JE09459
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE09459%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [auto1.es] INFO: Scrape type for JE09459: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb95ea64-15d0-56d5-ba31-04407065382c with identifier: JE09459
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb95ea64-15d0-56d5-ba31-04407065382c with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb95ea64-15d0-56d5-ba31-04407065382c with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb95ea64-15d0-56d5-ba31-04407065382c, identifier: JE09459
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb95ea64-15d0-56d5-ba31-04407065382c with identifier: JE09459
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb95ea64-15d0-56d5-ba31-04407065382c with identifier: JE09459
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb95ea64-15d0-56d5-ba31-04407065382c with identifier: JE09459 to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:14Z',
 'fuel_type': 'petrol',
 'id': 'bb95ea64-15d0-56d5-ba31-04407065382c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE09459',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 311129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE09459%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.es] INFO: Saving data for JE09459: {'auction_closing_time': 1774715114.0, 'created_time': 1773147247.688805, 'last_price_update_time': 1774695808.275402}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JE09459') HTTP/1.1" 204 0
2026-03-28 11:03:28 [auto1.es] INFO: Found listing with ID: XE32619
2026-03-28 11:03:28 [auto1.es] INFO: Found listing with ID: ZY33695
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY33695%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.es] INFO: Scrape type for ZY33695: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with identifier: ZY33695
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6, identifier: ZY33695
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with identifier: ZY33695
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with identifier: ZY33695
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f482e1c-3d1a-51b7-927c-2b45c2cf97c6 with identifier: ZY33695 to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-28T16:24:07Z',
 'fuel_type': 'hybrid',
 'id': '7f482e1c-3d1a-51b7-927c-2b45c2cf97c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY33695',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 254387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-23',
 'seller_name': None,
 'title': 'Renault Megane 1.6 E-Tech Hybrid Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY33695%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.es] INFO: Saving data for ZY33695: {'auction_closing_time': 1774715047.0, 'created_time': 1773900615.560969, 'last_price_update_time': 1774695808.829382}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY33695') HTTP/1.1" 204 0
2026-03-28 11:03:28 [auto1.es] INFO: Channel: 24h | Page: 56 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:28 [auto1.es] INFO: Found listing with ID: XC39222
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC39222%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [auto1.es] INFO: Scrape type for XC39222: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with identifier: XC39222
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01c29d90-2568-5ee8-ac6e-3bdf7f514173, identifier: XC39222
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with identifier: XC39222
2026-03-28 11:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with identifier: XC39222
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01c29d90-2568-5ee8-ac6e-3bdf7f514173 with identifier: XC39222 to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'diesel',
 'id': '01c29d90-2568-5ee8-ac6e-3bdf7f514173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC39222',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Toledo',
 'odometer': 192078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-30',
 'seller_name': None,
 'title': 'Seat Toledo 1.9 TDI Stella',
 'transmission': 'manual',
 'trim': 'Stella',
 'year': 2003}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC39222%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Saving data for XC39222: {'auction_closing_time': 1774716509.0, 'created_time': 1774609344.358877, 'last_price_update_time': 1774695809.206069}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC39222') HTTP/1.1" 204 0
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: VB06067
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB06067%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Scrape type for VB06067: 2
2026-03-28 11:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with identifier: VB06067
2026-03-28 11:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9, identifier: VB06067
2026-03-28 11:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: DH28057
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: LC81120
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC81120%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Scrape type for LC81120: 2
2026-03-28 11:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with identifier: LC81120
2026-03-28 11:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with scrape type 2
2026-03-28 11:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457, identifier: LC81120
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with identifier: VB06067
2026-03-28 11:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with identifier: VB06067
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9021fb1f-0ad6-553f-ac96-4ef48a73a3f9 with identifier: VB06067 to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:47Z',
 'fuel_type': 'diesel',
 'id': '9021fb1f-0ad6-553f-ac96-4ef48a73a3f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB06067',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 95237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-18',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2015}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB06067%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Saving data for VB06067: {'auction_closing_time': 1774716767.0, 'created_time': 1774609369.972393, 'last_price_update_time': 1774695809.679772}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB06067') HTTP/1.1" 204 0
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with identifier: LC81120
2026-03-28 11:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with identifier: LC81120
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457 with identifier: LC81120 to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:35Z',
 'fuel_type': 'diesel',
 'id': 'a9d1efbe-2378-5a2c-8ae3-0d9b81ecf457',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC81120',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 162047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Intensive',
 'transmission': 'automatic',
 'trim': 'Intensive',
 'year': 2015}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC81120%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Saving data for LC81120: {'auction_closing_time': 1774716335.0, 'created_time': 1774609287.092854, 'last_price_update_time': 1774695809.949409}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC81120') HTTP/1.1" 204 0
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: SA98238
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: LS65787
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: DA25807
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: MA79555
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA79555%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [auto1.es] INFO: Scrape type for MA79555: 0
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: TE50739
2026-03-28 11:03:29 [auto1.es] INFO: Found listing with ID: VL49161
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL49161%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [auto1.es] INFO: Scrape type for VL49161: 2
2026-03-28 11:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b1bb63-e821-573e-81a2-aea61718f8c1 with identifier: VL49161
2026-03-28 11:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b1bb63-e821-573e-81a2-aea61718f8c1 with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5b1bb63-e821-573e-81a2-aea61718f8c1 with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f5b1bb63-e821-573e-81a2-aea61718f8c1, identifier: VL49161
2026-03-28 11:03:30 [auto1.es] INFO: Found listing with ID: GD98283
2026-03-28 11:03:30 [auto1.es] INFO: Found listing with ID: CB57175
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB57175%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [auto1.es] INFO: Scrape type for CB57175: 2
2026-03-28 11:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a297fe07-e709-5264-835f-9ef7a203362a with identifier: CB57175
2026-03-28 11:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a297fe07-e709-5264-835f-9ef7a203362a with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a297fe07-e709-5264-835f-9ef7a203362a with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a297fe07-e709-5264-835f-9ef7a203362a, identifier: CB57175
2026-03-28 11:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f5b1bb63-e821-573e-81a2-aea61718f8c1 with identifier: VL49161
2026-03-28 11:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f5b1bb63-e821-573e-81a2-aea61718f8c1 with identifier: VL49161
2026-03-28 11:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f5b1bb63-e821-573e-81a2-aea61718f8c1 with identifier: VL49161 to the API
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:09:27Z',
 'fuel_type': 'diesel',
 'id': 'f5b1bb63-e821-573e-81a2-aea61718f8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL49161',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 187285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-25',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique Confort',
 'transmission': 'manual',
 'trim': 'Dynamique Confort',
 'year': 2004}
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL49161%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [auto1.es] INFO: Saving data for VL49161: {'auction_closing_time': 1774714167.0, 'created_time': 1774469037.400727, 'last_price_update_time': 1774695810.98362}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL49161') HTTP/1.1" 204 0
2026-03-28 11:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a297fe07-e709-5264-835f-9ef7a203362a with identifier: CB57175
2026-03-28 11:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a297fe07-e709-5264-835f-9ef7a203362a with identifier: CB57175
2026-03-28 11:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a297fe07-e709-5264-835f-9ef7a203362a with identifier: CB57175 to the API
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:49:14Z',
 'fuel_type': 'petrol',
 'id': 'a297fe07-e709-5264-835f-9ef7a203362a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB57175',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 89073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-28',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2009}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB57175%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.es] INFO: Saving data for CB57175: {'auction_closing_time': 1774716554.0, 'created_time': 1774609367.78624, 'last_price_update_time': 1774695811.641438}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB57175') HTTP/1.1" 204 0
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: RT14519
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: WM24762
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: JE26942
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: XX85945
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: BT54234
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT54234%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.es] INFO: Scrape type for BT54234: 2
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with identifier: BT54234
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d77cd18-cd8d-51e6-a365-74c89fef82c9, identifier: BT54234
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: PZ72634
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: MS49436
2026-03-28 11:03:31 [auto1.es] INFO: Found listing with ID: RR62391
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR62391%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [auto1.es] INFO: Scrape type for RR62391: 2
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with identifier: RR62391
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 32983044-fe8e-5dd1-93cf-9eb6d57123b4, identifier: RR62391
2026-03-28 11:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with identifier: BT54234
2026-03-28 11:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with identifier: BT54234
2026-03-28 11:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d77cd18-cd8d-51e6-a365-74c89fef82c9 with identifier: BT54234 to the API
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:57Z',
 'fuel_type': 'diesel',
 'id': '6d77cd18-cd8d-51e6-a365-74c89fef82c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT54234',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Sport Edition BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Sport Edition BlueMotion Tech.',
 'year': 2015}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT54234%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.es] INFO: Saving data for BT54234: {'auction_closing_time': 1774716237.0, 'created_time': 1774609318.680155, 'last_price_update_time': 1774695812.139209}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT54234') HTTP/1.1" 204 0
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with identifier: RR62391
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with identifier: RR62391
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 32983044-fe8e-5dd1-93cf-9eb6d57123b4 with identifier: RR62391 to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:52:31Z',
 'fuel_type': 'diesel',
 'id': '32983044-fe8e-5dd1-93cf-9eb6d57123b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR62391',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 214690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RR62391%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.es] INFO: Saving data for RR62391: {'auction_closing_time': 1774716751.0, 'created_time': 1774609273.419385, 'last_price_update_time': 1774695812.493976}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RR62391') HTTP/1.1" 204 0
2026-03-28 11:03:32 [auto1.es] INFO: Found listing with ID: BE99512
2026-03-28 11:03:32 [auto1.es] INFO: Found listing with ID: CN53275
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN53275%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.es] INFO: Scrape type for CN53275: 2
2026-03-28 11:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcbad9bf-7753-5983-af16-b66eb328e7e4 with identifier: CN53275
2026-03-28 11:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcbad9bf-7753-5983-af16-b66eb328e7e4 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcbad9bf-7753-5983-af16-b66eb328e7e4 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bcbad9bf-7753-5983-af16-b66eb328e7e4, identifier: CN53275
2026-03-28 11:03:32 [auto1.es] INFO: Found listing with ID: AJ84089
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ84089%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.es] INFO: Scrape type for AJ84089: 2
2026-03-28 11:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with identifier: AJ84089
2026-03-28 11:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61dc7f32-9f89-528f-a1fa-a87ec9b46c32, identifier: AJ84089
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bcbad9bf-7753-5983-af16-b66eb328e7e4 with identifier: CN53275
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bcbad9bf-7753-5983-af16-b66eb328e7e4 with identifier: CN53275
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bcbad9bf-7753-5983-af16-b66eb328e7e4 with identifier: CN53275 to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:46:19Z',
 'fuel_type': 'diesel',
 'id': 'bcbad9bf-7753-5983-af16-b66eb328e7e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN53275',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 275460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN53275%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [auto1.es] INFO: Saving data for CN53275: {'auction_closing_time': 1774716379.0, 'created_time': 1774469057.613735, 'last_price_update_time': 1774695812.99401}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN53275') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with identifier: AJ84089
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with identifier: AJ84089
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 61dc7f32-9f89-528f-a1fa-a87ec9b46c32 with identifier: AJ84089 to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 137,
 'expiration_date': '2026-03-28T16:50:00Z',
 'fuel_type': 'diesel',
 'id': '61dc7f32-9f89-528f-a1fa-a87ec9b46c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ84089',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 309547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-24',
 'seller_name': None,
 'title': 'Ford Transit 2.4 TDCi FT 350 Lang',
 'transmission': 'manual',
 'trim': 'FT 350 Lang',
 'year': 2006}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ84089%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.es] INFO: Saving data for AJ84089: {'auction_closing_time': 1774716600.0, 'created_time': 1774609279.789698, 'last_price_update_time': 1774695813.353899}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ84089') HTTP/1.1" 204 0
2026-03-28 11:03:33 [auto1.es] INFO: Found listing with ID: TF04725
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF04725%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.es] INFO: Scrape type for TF04725: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c01ffbed-907b-5f65-9b6c-57df29ce9bdd with identifier: TF04725
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c01ffbed-907b-5f65-9b6c-57df29ce9bdd with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c01ffbed-907b-5f65-9b6c-57df29ce9bdd with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c01ffbed-907b-5f65-9b6c-57df29ce9bdd, identifier: TF04725
2026-03-28 11:03:33 [auto1.es] INFO: Found listing with ID: FB43319
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB43319%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.es] INFO: Scrape type for FB43319: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84a277d-a407-5972-950a-326fe648c1d7 with identifier: FB43319
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84a277d-a407-5972-950a-326fe648c1d7 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84a277d-a407-5972-950a-326fe648c1d7 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f84a277d-a407-5972-950a-326fe648c1d7, identifier: FB43319
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c01ffbed-907b-5f65-9b6c-57df29ce9bdd with identifier: TF04725
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c01ffbed-907b-5f65-9b6c-57df29ce9bdd with identifier: TF04725
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c01ffbed-907b-5f65-9b6c-57df29ce9bdd with identifier: TF04725 to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:13:13Z',
 'fuel_type': 'diesel',
 'id': 'c01ffbed-907b-5f65-9b6c-57df29ce9bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF04725',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 293382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 320 L1 Trend',
 'transmission': 'automatic',
 'trim': '320 L1 Trend',
 'year': 2019}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF04725%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [auto1.es] INFO: Saving data for TF04725: {'auction_closing_time': 1774714393.0, 'created_time': 1774609278.498887, 'last_price_update_time': 1774695813.837294}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF04725') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f84a277d-a407-5972-950a-326fe648c1d7 with identifier: FB43319
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f84a277d-a407-5972-950a-326fe648c1d7 with identifier: FB43319
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f84a277d-a407-5972-950a-326fe648c1d7 with identifier: FB43319 to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:42:40Z',
 'fuel_type': 'diesel',
 'id': 'f84a277d-a407-5972-950a-326fe648c1d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB43319',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 807931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueTEC Avantgarde',
 'year': 2014}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB43319%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Saving data for FB43319: {'auction_closing_time': 1774716160.0, 'created_time': 1774609279.393551, 'last_price_update_time': 1774695814.107119}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FB43319') HTTP/1.1" 204 0
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: RN90591
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: TC61442
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: PT49535
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT49535%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Scrape type for PT49535: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with identifier: PT49535
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b83cf1a1-95f1-547e-a4c2-3ed13e1f4143, identifier: PT49535
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: XC46914
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: RM79142
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM79142%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Scrape type for RM79142: 0
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: JY09497
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Scrape type for JY09497: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a5fe52-f875-55f6-89d0-4d475e35d202 with identifier: JY09497
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a5fe52-f875-55f6-89d0-4d475e35d202 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a5fe52-f875-55f6-89d0-4d475e35d202 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28a5fe52-f875-55f6-89d0-4d475e35d202, identifier: JY09497
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with identifier: PT49535
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with identifier: PT49535
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b83cf1a1-95f1-547e-a4c2-3ed13e1f4143 with identifier: PT49535 to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:23:44Z',
 'fuel_type': 'diesel',
 'id': 'b83cf1a1-95f1-547e-a4c2-3ed13e1f4143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT49535',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 143034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-19',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2017}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT49535%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Saving data for PT49535: {'auction_closing_time': 1774715024.0, 'created_time': 1774609272.969147, 'last_price_update_time': 1774695814.613909}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT49535') HTTP/1.1" 204 0
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28a5fe52-f875-55f6-89d0-4d475e35d202 with identifier: JY09497
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28a5fe52-f875-55f6-89d0-4d475e35d202 with identifier: JY09497
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 28a5fe52-f875-55f6-89d0-4d475e35d202 with identifier: JY09497 to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:09:34Z',
 'fuel_type': 'diesel',
 'id': '28a5fe52-f875-55f6-89d0-4d475e35d202',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY09497',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 285935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY09497%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Saving data for JY09497: {'auction_closing_time': 1774714174.0, 'created_time': 1773129008.813359, 'last_price_update_time': 1774695814.914257}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JY09497') HTTP/1.1" 204 0
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: AL30564
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: KE47103
2026-03-28 11:03:34 [auto1.es] INFO: Found listing with ID: SF05146
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF05146%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [auto1.es] INFO: Scrape type for SF05146: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with identifier: SF05146
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18065b09-3c4d-570a-9b5b-ca21fb73ff5c, identifier: SF05146
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: TD25649
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: AS51467
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: NZ54247
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: WE21693
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE21693%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Scrape type for WE21693: 0
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: FR95558
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: ZE41555
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: HM27570
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: AL28647
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL28647%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Scrape type for AL28647: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f, identifier: AL28647
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with identifier: SF05146
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with identifier: SF05146
2026-03-28 11:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 18065b09-3c4d-570a-9b5b-ca21fb73ff5c with identifier: SF05146 to the API
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:43Z',
 'fuel_type': 'petrol',
 'id': '18065b09-3c4d-570a-9b5b-ca21fb73ff5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF05146',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 125010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-31',
 'seller_name': None,
 'title': 'Ford Ka 1.3 Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2004}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF05146%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Saving data for SF05146: {'auction_closing_time': 1774715383.0, 'created_time': 1774609317.31311, 'last_price_update_time': 1774695815.410622}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SF05146') HTTP/1.1" 204 0
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647
2026-03-28 11:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6362e0ac-fcb2-5541-9de0-c0edf7c5832f with identifier: AL28647 to the API
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:49:28Z',
 'fuel_type': 'diesel',
 'id': '6362e0ac-fcb2-5541-9de0-c0edf7c5832f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL28647',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 298819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-02',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL28647%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Saving data for AL28647: {'auction_closing_time': 1774716568.0, 'created_time': 1773691459.682559, 'last_price_update_time': 1774695815.800589}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL28647') HTTP/1.1" 204 0
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: GX55521
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: EL12224
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: EE07728
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: LB97818
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: SU20973
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: RD73162
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73162%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Scrape type for RD73162: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de4b0819-1b21-5a29-9e87-146741ec171b with identifier: RD73162
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de4b0819-1b21-5a29-9e87-146741ec171b with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de4b0819-1b21-5a29-9e87-146741ec171b with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de4b0819-1b21-5a29-9e87-146741ec171b, identifier: RD73162
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: PC53610
2026-03-28 11:03:35 [auto1.es] INFO: Found listing with ID: KM47082
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM47082%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [auto1.es] INFO: Scrape type for KM47082: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44d621a2-3ad3-5091-b09f-d5e7b4355b49, identifier: KM47082
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de4b0819-1b21-5a29-9e87-146741ec171b with identifier: RD73162
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de4b0819-1b21-5a29-9e87-146741ec171b with identifier: RD73162
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de4b0819-1b21-5a29-9e87-146741ec171b with identifier: RD73162 to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:29:21Z',
 'fuel_type': 'diesel',
 'id': 'de4b0819-1b21-5a29-9e87-146741ec171b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD73162',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 135516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 JTD Basis Kasten',
 'transmission': 'manual',
 'trim': 'Basis Kasten',
 'year': 2017}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD73162%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.es] INFO: Saving data for RD73162: {'auction_closing_time': 1774715361.0, 'created_time': 1774609318.11583, 'last_price_update_time': 1774695816.302875}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD73162') HTTP/1.1" 204 0
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 44d621a2-3ad3-5091-b09f-d5e7b4355b49 with identifier: KM47082 to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 344,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'diesel',
 'id': '44d621a2-3ad3-5091-b09f-d5e7b4355b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM47082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 63899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM47082%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.es] INFO: Saving data for KM47082: {'auction_closing_time': 1774716114.0, 'created_time': 1774609372.637448, 'last_price_update_time': 1774695816.563707}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM47082') HTTP/1.1" 204 0
2026-03-28 11:03:36 [auto1.es] INFO: Found listing with ID: LE09183
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE09183%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.es] INFO: Scrape type for LE09183: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5, identifier: LE09183
2026-03-28 11:03:36 [auto1.es] INFO: Found listing with ID: FJ09985
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ09985%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [auto1.es] INFO: Scrape type for FJ09985: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d8e46e-1553-5c07-98a3-f71f09278297 with identifier: FJ09985
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d8e46e-1553-5c07-98a3-f71f09278297 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d8e46e-1553-5c07-98a3-f71f09278297 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50d8e46e-1553-5c07-98a3-f71f09278297, identifier: FJ09985
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5afb2734-c87a-5d0c-977e-d4c72abbd6f5 with identifier: LE09183 to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:06Z',
 'fuel_type': 'diesel',
 'id': '5afb2734-c87a-5d0c-977e-d4c72abbd6f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE09183',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 262896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LE09183%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.es] INFO: Saving data for LE09183: {'auction_closing_time': 1774716846.0, 'created_time': 1774037002.641024, 'last_price_update_time': 1774695817.102619}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LE09183') HTTP/1.1" 204 0
2026-03-28 11:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50d8e46e-1553-5c07-98a3-f71f09278297 with identifier: FJ09985
2026-03-28 11:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50d8e46e-1553-5c07-98a3-f71f09278297 with identifier: FJ09985
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 50d8e46e-1553-5c07-98a3-f71f09278297 with identifier: FJ09985 to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:24Z',
 'fuel_type': 'petrol',
 'id': '50d8e46e-1553-5c07-98a3-f71f09278297',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ09985',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 166966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-11',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FJ09985%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.es] INFO: Saving data for FJ09985: {'auction_closing_time': 1774716624.0, 'created_time': 1774037016.21332, 'last_price_update_time': 1774695817.419665}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FJ09985') HTTP/1.1" 204 0
2026-03-28 11:03:37 [auto1.es] INFO: Found listing with ID: DL40805
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL40805%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.es] INFO: Scrape type for DL40805: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a31717-1267-56ce-b8ae-c60a67997190 with identifier: DL40805
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a31717-1267-56ce-b8ae-c60a67997190 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a31717-1267-56ce-b8ae-c60a67997190 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13a31717-1267-56ce-b8ae-c60a67997190, identifier: DL40805
2026-03-28 11:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:37 [auto1.es] INFO: Found listing with ID: JZ86442
2026-03-28 11:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13a31717-1267-56ce-b8ae-c60a67997190 with identifier: DL40805
2026-03-28 11:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13a31717-1267-56ce-b8ae-c60a67997190 with identifier: DL40805
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13a31717-1267-56ce-b8ae-c60a67997190 with identifier: DL40805 to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:59:27Z',
 'fuel_type': 'diesel',
 'id': '13a31717-1267-56ce-b8ae-c60a67997190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL40805',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 331309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL40805%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.es] INFO: Saving data for DL40805: {'auction_closing_time': 1774717167.0, 'created_time': 1774609277.240301, 'last_price_update_time': 1774695817.80055}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL40805') HTTP/1.1" 204 0
2026-03-28 11:03:37 [auto1.es] INFO: Found listing with ID: AW49477
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW49477%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [auto1.es] INFO: Scrape type for AW49477: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6d7c48-8166-5280-9c70-c597329ee753 with identifier: AW49477
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6d7c48-8166-5280-9c70-c597329ee753 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f6d7c48-8166-5280-9c70-c597329ee753 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5f6d7c48-8166-5280-9c70-c597329ee753, identifier: AW49477
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5f6d7c48-8166-5280-9c70-c597329ee753 with identifier: AW49477
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5f6d7c48-8166-5280-9c70-c597329ee753 with identifier: AW49477
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5f6d7c48-8166-5280-9c70-c597329ee753 with identifier: AW49477 to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:55:36Z',
 'fuel_type': 'diesel',
 'id': '5f6d7c48-8166-5280-9c70-c597329ee753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW49477',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 38257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-09',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW49477%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Saving data for AW49477: {'auction_closing_time': 1774716936.0, 'created_time': 1774609313.096661, 'last_price_update_time': 1774695818.291622}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AW49477') HTTP/1.1" 204 0
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: TB74372
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB74372%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Scrape type for TB74372: 2
2026-03-28 11:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b852af37-cba7-5164-9eda-d0b1745f3fdc with identifier: TB74372
2026-03-28 11:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b852af37-cba7-5164-9eda-d0b1745f3fdc with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b852af37-cba7-5164-9eda-d0b1745f3fdc with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b852af37-cba7-5164-9eda-d0b1745f3fdc, identifier: TB74372
2026-03-28 11:03:38 [auto1.es] INFO: Channel: 24h | Page: 57 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b852af37-cba7-5164-9eda-d0b1745f3fdc with identifier: TB74372
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b852af37-cba7-5164-9eda-d0b1745f3fdc with identifier: TB74372
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b852af37-cba7-5164-9eda-d0b1745f3fdc with identifier: TB74372 to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:11:22Z',
 'fuel_type': 'petrol',
 'id': 'b852af37-cba7-5164-9eda-d0b1745f3fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB74372',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 108845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-26',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Tekna Premium',
 'transmission': 'manual',
 'trim': 'Tekna Premium',
 'year': 2010}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB74372%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Saving data for TB74372: {'auction_closing_time': 1774714282.0, 'created_time': 1774609287.883857, 'last_price_update_time': 1774695818.674768}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB74372') HTTP/1.1" 204 0
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: LU79245
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: RV28339
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: AE79363
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE79363%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Scrape type for AE79363: 0
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: BP19645
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP19645%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Scrape type for BP19645: 0
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: RB19136
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB19136%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Scrape type for RB19136: 2
2026-03-28 11:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39f1e09-3f00-5eec-ae51-aa24888e016c with identifier: RB19136
2026-03-28 11:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39f1e09-3f00-5eec-ae51-aa24888e016c with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e39f1e09-3f00-5eec-ae51-aa24888e016c with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e39f1e09-3f00-5eec-ae51-aa24888e016c, identifier: RB19136
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: XF10257
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF10257%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [auto1.es] INFO: Scrape type for XF10257: 0
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: UA88301
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: TT54847
2026-03-28 11:03:38 [auto1.es] INFO: Found listing with ID: MF03574
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF03574%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.es] INFO: Scrape type for MF03574: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195f16db-b74f-56b6-9f74-310267e53568 with identifier: MF03574
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195f16db-b74f-56b6-9f74-310267e53568 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 195f16db-b74f-56b6-9f74-310267e53568 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 195f16db-b74f-56b6-9f74-310267e53568, identifier: MF03574
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e39f1e09-3f00-5eec-ae51-aa24888e016c with identifier: RB19136
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e39f1e09-3f00-5eec-ae51-aa24888e016c with identifier: RB19136
2026-03-28 11:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e39f1e09-3f00-5eec-ae51-aa24888e016c with identifier: RB19136 to the API
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:19:16Z',
 'fuel_type': 'diesel',
 'id': 'e39f1e09-3f00-5eec-ae51-aa24888e016c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB19136',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 218541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB19136%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.es] INFO: Saving data for RB19136: {'auction_closing_time': 1774714756.0, 'created_time': 1774609286.134944, 'last_price_update_time': 1774695819.373097}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RB19136') HTTP/1.1" 204 0
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 195f16db-b74f-56b6-9f74-310267e53568 with identifier: MF03574
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 195f16db-b74f-56b6-9f74-310267e53568 with identifier: MF03574
2026-03-28 11:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 195f16db-b74f-56b6-9f74-310267e53568 with identifier: MF03574 to the API
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:28Z',
 'fuel_type': 'diesel',
 'id': '195f16db-b74f-56b6-9f74-310267e53568',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF03574',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 347811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-23',
 'seller_name': None,
 'title': 'Renault Laguna 2.0 dCi Emotion Plus',
 'transmission': 'manual',
 'trim': 'Emotion Plus',
 'year': 2010}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MF03574%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.es] INFO: Saving data for MF03574: {'auction_closing_time': 1774715728.0, 'created_time': 1774609284.822485, 'last_price_update_time': 1774695819.734182}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MF03574') HTTP/1.1" 204 0
2026-03-28 11:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:39 [auto1.es] INFO: Found listing with ID: HC67204
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC67204%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.es] INFO: Scrape type for HC67204: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce9b41f-2613-551a-94c2-91ab8d9823fd with identifier: HC67204
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce9b41f-2613-551a-94c2-91ab8d9823fd with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce9b41f-2613-551a-94c2-91ab8d9823fd with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bce9b41f-2613-551a-94c2-91ab8d9823fd, identifier: HC67204
2026-03-28 11:03:39 [auto1.es] INFO: Found listing with ID: CZ73203
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ73203%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [auto1.es] INFO: Scrape type for CZ73203: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63be8a2-56c3-5d32-8f94-c452e2ba3014 with identifier: CZ73203
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63be8a2-56c3-5d32-8f94-c452e2ba3014 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63be8a2-56c3-5d32-8f94-c452e2ba3014 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e63be8a2-56c3-5d32-8f94-c452e2ba3014, identifier: CZ73203
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bce9b41f-2613-551a-94c2-91ab8d9823fd with identifier: HC67204
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bce9b41f-2613-551a-94c2-91ab8d9823fd with identifier: HC67204
2026-03-28 11:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bce9b41f-2613-551a-94c2-91ab8d9823fd with identifier: HC67204 to the API
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:05Z',
 'fuel_type': 'diesel',
 'id': 'bce9b41f-2613-551a-94c2-91ab8d9823fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC67204',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 140249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC67204%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [auto1.es] INFO: Saving data for HC67204: {'auction_closing_time': 1774714625.0, 'created_time': 1774609276.080789, 'last_price_update_time': 1774695820.249298}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC67204') HTTP/1.1" 204 0
2026-03-28 11:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e63be8a2-56c3-5d32-8f94-c452e2ba3014 with identifier: CZ73203
2026-03-28 11:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e63be8a2-56c3-5d32-8f94-c452e2ba3014 with identifier: CZ73203
2026-03-28 11:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e63be8a2-56c3-5d32-8f94-c452e2ba3014 with identifier: CZ73203 to the API
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:52Z',
 'fuel_type': 'petrol',
 'id': 'e63be8a2-56c3-5d32-8f94-c452e2ba3014',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ73203',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 106600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP W-OneTone',
 'transmission': 'manual',
 'trim': 'W-OneTone',
 'year': 2017}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ73203%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [auto1.es] INFO: Saving data for CZ73203: {'auction_closing_time': 1774715632.0, 'created_time': 1773918119.659311, 'last_price_update_time': 1774695820.99097}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ73203') HTTP/1.1" 204 0
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: EL32039
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: YD48242
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: SB84191
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: AJ53679
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ53679%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Scrape type for AJ53679: 0
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: ER99924
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER99924%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Scrape type for ER99924: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3ac6418-f001-5349-b9bd-5685e2050f28 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3ac6418-f001-5349-b9bd-5685e2050f28 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f3ac6418-f001-5349-b9bd-5685e2050f28, identifier: ER99924
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924
2026-03-28 11:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f3ac6418-f001-5349-b9bd-5685e2050f28 with identifier: ER99924 to the API
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:29:23Z',
 'fuel_type': 'petrol',
 'id': 'f3ac6418-f001-5349-b9bd-5685e2050f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER99924',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 150847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-20',
 'seller_name': None,
 'title': 'Kia Rio 1.2 X-Tech',
 'transmission': 'manual',
 'trim': 'X-Tech',
 'year': 2015}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ER99924%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Saving data for ER99924: {'auction_closing_time': 1774715363.0, 'created_time': 1773432325.565716, 'last_price_update_time': 1774695821.387264}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ER99924') HTTP/1.1" 204 0
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: AJ63740
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ63740%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Scrape type for AJ63740: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5, identifier: AJ63740
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740
2026-03-28 11:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5 with identifier: AJ63740 to the API
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:43Z',
 'fuel_type': 'diesel',
 'id': '29fc398c-7d9c-5fa4-ae6f-6b6819d1d6d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ63740',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 293747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ63740%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Saving data for AJ63740: {'auction_closing_time': 1774713883.0, 'created_time': 1774296110.558254, 'last_price_update_time': 1774695821.795262}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ63740') HTTP/1.1" 204 0
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: MG24035
2026-03-28 11:03:41 [auto1.es] INFO: Found listing with ID: AG87385
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG87385%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.es] INFO: Scrape type for AG87385: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9090ad5-cf21-5299-848a-cb0817ce921e with identifier: AG87385
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9090ad5-cf21-5299-848a-cb0817ce921e with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9090ad5-cf21-5299-848a-cb0817ce921e with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9090ad5-cf21-5299-848a-cb0817ce921e, identifier: AG87385
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9090ad5-cf21-5299-848a-cb0817ce921e with identifier: AG87385
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9090ad5-cf21-5299-848a-cb0817ce921e with identifier: AG87385
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c9090ad5-cf21-5299-848a-cb0817ce921e with identifier: AG87385 to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:47:13Z',
 'fuel_type': 'petrol',
 'id': 'c9090ad5-cf21-5299-848a-cb0817ce921e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG87385',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 76668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2020}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG87385%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.es] INFO: Saving data for AG87385: {'auction_closing_time': 1774716433.0, 'created_time': 1772628266.588758, 'last_price_update_time': 1774695822.219843}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG87385') HTTP/1.1" 204 0
2026-03-28 11:03:42 [auto1.es] INFO: Found listing with ID: XW95149
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW95149%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.es] INFO: Scrape type for XW95149: 2
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48946d71-6569-5180-a216-f14867d839b1 with identifier: XW95149
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48946d71-6569-5180-a216-f14867d839b1 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48946d71-6569-5180-a216-f14867d839b1 with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 48946d71-6569-5180-a216-f14867d839b1, identifier: XW95149
2026-03-28 11:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 48946d71-6569-5180-a216-f14867d839b1 with identifier: XW95149
2026-03-28 11:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 48946d71-6569-5180-a216-f14867d839b1 with identifier: XW95149
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 48946d71-6569-5180-a216-f14867d839b1 with identifier: XW95149 to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:35:43Z',
 'fuel_type': 'petrol',
 'id': '48946d71-6569-5180-a216-f14867d839b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW95149',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 13143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW95149%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.es] INFO: Saving data for XW95149: {'auction_closing_time': 1774715743.0, 'created_time': 1772143260.17313, 'last_price_update_time': 1774695822.64025}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XW95149') HTTP/1.1" 204 0
2026-03-28 11:03:42 [auto1.es] INFO: Found listing with ID: SY91293
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY91293%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [auto1.es] INFO: Scrape type for SY91293: 2
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0878992-207c-59db-8e40-86b2d155481e with identifier: SY91293
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0878992-207c-59db-8e40-86b2d155481e with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0878992-207c-59db-8e40-86b2d155481e with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0878992-207c-59db-8e40-86b2d155481e, identifier: SY91293
2026-03-28 11:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0878992-207c-59db-8e40-86b2d155481e with identifier: SY91293
2026-03-28 11:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0878992-207c-59db-8e40-86b2d155481e with identifier: SY91293
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0878992-207c-59db-8e40-86b2d155481e with identifier: SY91293 to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:35:40Z',
 'fuel_type': 'petrol',
 'id': 'b0878992-207c-59db-8e40-86b2d155481e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY91293',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 107741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2019}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY91293%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.es] INFO: Saving data for SY91293: {'auction_closing_time': 1774715740.0, 'created_time': 1772143054.482986, 'last_price_update_time': 1774695823.164208}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY91293') HTTP/1.1" 204 0
2026-03-28 11:03:43 [auto1.es] INFO: Found listing with ID: JC49855
2026-03-28 11:03:43 [auto1.es] INFO: Found listing with ID: DM43927
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM43927%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.es] INFO: Scrape type for DM43927: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d47060-5ed4-5646-b089-681c7be48cba with identifier: DM43927
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77d47060-5ed4-5646-b089-681c7be48cba with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77d47060-5ed4-5646-b089-681c7be48cba with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 77d47060-5ed4-5646-b089-681c7be48cba, identifier: DM43927
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 77d47060-5ed4-5646-b089-681c7be48cba with identifier: DM43927
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 77d47060-5ed4-5646-b089-681c7be48cba with identifier: DM43927
2026-03-28 11:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 77d47060-5ed4-5646-b089-681c7be48cba with identifier: DM43927 to the API
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:50Z',
 'fuel_type': 'petrol',
 'id': '77d47060-5ed4-5646-b089-681c7be48cba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM43927',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Austral',
 'odometer': 78322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-28',
 'seller_name': None,
 'title': 'Renault Austral 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'manual',
 'trim': 'Techno',
 'year': 2022}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM43927%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.es] INFO: Saving data for DM43927: {'auction_closing_time': 1774713830.0, 'created_time': 1772626110.93552, 'last_price_update_time': 1774695823.576351}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM43927') HTTP/1.1" 204 0
2026-03-28 11:03:43 [auto1.es] INFO: Found listing with ID: ZH88989
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH88989%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.es] INFO: Scrape type for ZH88989: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d92defd-cc60-5979-b277-0b28662926c5 with identifier: ZH88989
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d92defd-cc60-5979-b277-0b28662926c5 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d92defd-cc60-5979-b277-0b28662926c5 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d92defd-cc60-5979-b277-0b28662926c5, identifier: ZH88989
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d92defd-cc60-5979-b277-0b28662926c5 with identifier: ZH88989
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d92defd-cc60-5979-b277-0b28662926c5 with identifier: ZH88989
2026-03-28 11:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d92defd-cc60-5979-b277-0b28662926c5 with identifier: ZH88989 to the API
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:06:07Z',
 'fuel_type': 'diesel',
 'id': '4d92defd-cc60-5979-b277-0b28662926c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH88989',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 328490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-10',
 'seller_name': None,
 'title': 'BMW 4er 420d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH88989%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [auto1.es] INFO: Saving data for ZH88989: {'auction_closing_time': 1774713967.0, 'created_time': 1774015472.671069, 'last_price_update_time': 1774695823.953118}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH88989') HTTP/1.1" 204 0
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: AV04114
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: NN13578
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN13578%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Scrape type for NN13578: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9edea55b-f1a9-5187-9765-a778114d2a6d with identifier: NN13578
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9edea55b-f1a9-5187-9765-a778114d2a6d with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9edea55b-f1a9-5187-9765-a778114d2a6d with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9edea55b-f1a9-5187-9765-a778114d2a6d, identifier: NN13578
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9edea55b-f1a9-5187-9765-a778114d2a6d with identifier: NN13578
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9edea55b-f1a9-5187-9765-a778114d2a6d with identifier: NN13578
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9edea55b-f1a9-5187-9765-a778114d2a6d with identifier: NN13578 to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:51:22Z',
 'fuel_type': 'diesel',
 'id': '9edea55b-f1a9-5187-9765-a778114d2a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN13578',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 146333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Shuttle',
 'transmission': 'automatic',
 'trim': 'L1 Shuttle',
 'year': 2018}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN13578%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Saving data for NN13578: {'auction_closing_time': 1774716682.0, 'created_time': 1773181556.987186, 'last_price_update_time': 1774695824.378036}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN13578') HTTP/1.1" 204 0
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: JB50336
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: XJ92197
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: TV08054
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: MA21066
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: UK85840
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK85840%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Scrape type for UK85840: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with identifier: UK85840
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47, identifier: UK85840
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with identifier: UK85840
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with identifier: UK85840
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47 with identifier: UK85840 to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:44:11Z',
 'fuel_type': 'diesel',
 'id': 'aaa9d898-e0fd-5bdf-9a0d-0e835e4a3e47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK85840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 370979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-03',
 'seller_name': None,
 'title': 'Volkswagen Passat CC 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK85840%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Saving data for UK85840: {'auction_closing_time': 1774716251.0, 'created_time': 1774469161.144527, 'last_price_update_time': 1774695824.759846}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UK85840') HTTP/1.1" 204 0
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: HZ40578
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: AH95116
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH95116%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Scrape type for AH95116: 0
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: ML07808
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML07808%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Scrape type for ML07808: 0
2026-03-28 11:03:44 [auto1.es] INFO: Found listing with ID: NE97244
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE97244%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [auto1.es] INFO: Scrape type for NE97244: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with identifier: NE97244
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2dfcaa55-e787-57f5-96ff-5d5c92e48989, identifier: NE97244
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with identifier: NE97244
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with identifier: NE97244
2026-03-28 11:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2dfcaa55-e787-57f5-96ff-5d5c92e48989 with identifier: NE97244 to the API
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'diesel',
 'id': '2dfcaa55-e787-57f5-96ff-5d5c92e48989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE97244',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 312156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-11',
 'seller_name': None,
 'title': 'Ford Focus 1.8 TDDI Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 1999}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE97244%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Saving data for NE97244: {'auction_closing_time': 1774716544.0, 'created_time': 1774468983.366061, 'last_price_update_time': 1774695825.306063}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NE97244') HTTP/1.1" 204 0
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: UF15640
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: UV13351
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UV13351%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Scrape type for UV13351: 0
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: JY25444
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JY25444%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Scrape type for JY25444: 0
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: CU51757
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: EY86051
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: GP92404
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP92404%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Scrape type for GP92404: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450c0fe9-a216-552d-a854-73b90aeee54a with identifier: GP92404
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450c0fe9-a216-552d-a854-73b90aeee54a with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450c0fe9-a216-552d-a854-73b90aeee54a with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 450c0fe9-a216-552d-a854-73b90aeee54a, identifier: GP92404
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 450c0fe9-a216-552d-a854-73b90aeee54a with identifier: GP92404
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 450c0fe9-a216-552d-a854-73b90aeee54a with identifier: GP92404
2026-03-28 11:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 450c0fe9-a216-552d-a854-73b90aeee54a with identifier: GP92404 to the API
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:54:16Z',
 'fuel_type': 'petrol',
 'id': '450c0fe9-a216-552d-a854-73b90aeee54a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP92404',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 112666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP92404%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Saving data for GP92404: {'auction_closing_time': 1774716856.0, 'created_time': 1774609350.864312, 'last_price_update_time': 1774695825.767103}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP92404') HTTP/1.1" 204 0
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: NB97215
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: PK58195
2026-03-28 11:03:45 [auto1.es] INFO: Found listing with ID: SG84832
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.es] INFO: Scrape type for SG84832: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e, identifier: SG84832
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832
2026-03-28 11:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c20f10ad-b73a-5089-9d6a-1bb3eec5e65e with identifier: SG84832 to the API
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-28T16:31:37Z',
 'fuel_type': 'diesel',
 'id': 'c20f10ad-b73a-5089-9d6a-1bb3eec5e65e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG84832',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 191932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
 'transmission': 'manual',
 'trim': '20 Aniversario Edition',
 'year': 2018}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG84832%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.es] INFO: Saving data for SG84832: {'auction_closing_time': 1774715497.0, 'created_time': 1774609351.489364, 'last_price_update_time': 1774695826.170813}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG84832') HTTP/1.1" 204 0
2026-03-28 11:03:46 [auto1.es] INFO: Found listing with ID: NK92990
2026-03-28 11:03:46 [auto1.es] INFO: Found listing with ID: UU25578
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU25578%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.es] INFO: Scrape type for UU25578: 2
2026-03-28 11:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9320a49d-b350-5bc5-b828-8476a2774492 with identifier: UU25578
2026-03-28 11:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9320a49d-b350-5bc5-b828-8476a2774492 with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9320a49d-b350-5bc5-b828-8476a2774492 with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9320a49d-b350-5bc5-b828-8476a2774492, identifier: UU25578
2026-03-28 11:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9320a49d-b350-5bc5-b828-8476a2774492 with identifier: UU25578
2026-03-28 11:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9320a49d-b350-5bc5-b828-8476a2774492 with identifier: UU25578
2026-03-28 11:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9320a49d-b350-5bc5-b828-8476a2774492 with identifier: UU25578 to the API
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:29:44Z',
 'fuel_type': 'diesel',
 'id': '9320a49d-b350-5bc5-b828-8476a2774492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU25578',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 170036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-13',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 Blue dCi 15th Anniversary',
 'transmission': 'manual',
 'trim': '15th Anniversary',
 'year': 2021}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU25578%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.es] INFO: Saving data for UU25578: {'auction_closing_time': 1774715384.0, 'created_time': 1774296277.711899, 'last_price_update_time': 1774695826.640458}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UU25578') HTTP/1.1" 204 0
2026-03-28 11:03:46 [auto1.es] INFO: Found listing with ID: AB11281
2026-03-28 11:03:46 [auto1.es] INFO: Found listing with ID: PE24027
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE24027%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.es] INFO: Scrape type for PE24027: 2
2026-03-28 11:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with identifier: PE24027
2026-03-28 11:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fbd8aed-4983-579a-ad68-1d9edc8fed4a, identifier: PE24027
2026-03-28 11:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with identifier: PE24027
2026-03-28 11:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with identifier: PE24027
2026-03-28 11:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9fbd8aed-4983-579a-ad68-1d9edc8fed4a with identifier: PE24027 to the API
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'diesel',
 'id': '9fbd8aed-4983-579a-ad68-1d9edc8fed4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE24027',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 254343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE24027%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [auto1.es] INFO: Saving data for PE24027: {'auction_closing_time': 1774716389.0, 'created_time': 1773691524.130094, 'last_price_update_time': 1774695827.2976}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE24027') HTTP/1.1" 204 0
2026-03-28 11:03:47 [auto1.es] INFO: Found listing with ID: GN52396
2026-03-28 11:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:49 [auto1.es] INFO: Channel: 24h | Page: 58 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: ZA21810
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: BJ36748
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: AV93278
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: AW04396
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW04396%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.es] INFO: Scrape type for AW04396: 2
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a309712-bdc5-568e-936c-6b034dc46d72 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a309712-bdc5-568e-936c-6b034dc46d72 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a309712-bdc5-568e-936c-6b034dc46d72, identifier: AW04396
2026-03-28 11:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-03-28 11:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396
2026-03-28 11:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5a309712-bdc5-568e-936c-6b034dc46d72 with identifier: AW04396 to the API
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:47:58Z',
 'fuel_type': 'diesel',
 'id': '5a309712-bdc5-568e-936c-6b034dc46d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW04396',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 140025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-12',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW04396%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.es] INFO: Saving data for AW04396: {'auction_closing_time': 1774716478.0, 'created_time': 1773691446.272894, 'last_price_update_time': 1774695829.65833}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AW04396') HTTP/1.1" 204 0
2026-03-28 11:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: MA61086
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: PS45222
2026-03-28 11:03:49 [auto1.es] INFO: Found listing with ID: ZZ72823
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ72823%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [auto1.es] INFO: Scrape type for ZZ72823: 2
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b25e1e-ce28-587a-830c-280392c07d63 with identifier: ZZ72823
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b25e1e-ce28-587a-830c-280392c07d63 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b25e1e-ce28-587a-830c-280392c07d63 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f6b25e1e-ce28-587a-830c-280392c07d63, identifier: ZZ72823
2026-03-28 11:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f6b25e1e-ce28-587a-830c-280392c07d63 with identifier: ZZ72823
2026-03-28 11:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f6b25e1e-ce28-587a-830c-280392c07d63 with identifier: ZZ72823
2026-03-28 11:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f6b25e1e-ce28-587a-830c-280392c07d63 with identifier: ZZ72823 to the API
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:38Z',
 'fuel_type': 'gas',
 'id': 'f6b25e1e-ce28-587a-830c-280392c07d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ72823',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 56875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TGI FR Edition',
 'transmission': 'manual',
 'trim': 'FR Edition',
 'year': 2020}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZZ72823%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.es] INFO: Saving data for ZZ72823: {'auction_closing_time': 1774716938.0, 'created_time': 1774263706.307915, 'last_price_update_time': 1774695830.074464}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZZ72823') HTTP/1.1" 204 0
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: CW88498
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW88498%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.es] INFO: Scrape type for CW88498: 0
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: KR67716
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: NZ88130
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: EA95786
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA95786%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.es] INFO: Scrape type for EA95786: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with identifier: EA95786
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc1e4183-a26d-5e56-a9a2-e0f9aea52e78, identifier: EA95786
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with identifier: EA95786
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with identifier: EA95786
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc1e4183-a26d-5e56-a9a2-e0f9aea52e78 with identifier: EA95786 to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:52:21Z',
 'fuel_type': 'hybrid',
 'id': 'dc1e4183-a26d-5e56-a9a2-e0f9aea52e78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA95786',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 106655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': None,
 'title': 'Kia Sorento 1.6 TGDI Hybrid Emotion 2WD',
 'transmission': 'automatic',
 'trim': 'Emotion 2WD',
 'year': 2022}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA95786%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.es] INFO: Saving data for EA95786: {'auction_closing_time': 1774716741.0, 'created_time': 1772624557.84272, 'last_price_update_time': 1774695830.628992}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA95786') HTTP/1.1" 204 0
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: GS59468
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: NL01395
2026-03-28 11:03:50 [auto1.es] INFO: Found listing with ID: FD66693
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66693%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [auto1.es] INFO: Scrape type for FD66693: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c44a4a5c-c853-521b-be04-d8266e96011e with identifier: FD66693
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c44a4a5c-c853-521b-be04-d8266e96011e with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c44a4a5c-c853-521b-be04-d8266e96011e with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c44a4a5c-c853-521b-be04-d8266e96011e, identifier: FD66693
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c44a4a5c-c853-521b-be04-d8266e96011e with identifier: FD66693
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c44a4a5c-c853-521b-be04-d8266e96011e with identifier: FD66693
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c44a4a5c-c853-521b-be04-d8266e96011e with identifier: FD66693 to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:35:00Z',
 'fuel_type': 'diesel',
 'id': 'c44a4a5c-c853-521b-be04-d8266e96011e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD66693',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 177653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-16',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD66693%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Saving data for FD66693: {'auction_closing_time': 1774715700.0, 'created_time': 1773127975.470357, 'last_price_update_time': 1774695831.061829}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD66693') HTTP/1.1" 204 0
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: MZ54464
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: CB03666
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Scrape type for CB03666: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4405bf-8d5a-585e-99de-9525775a8b1d with identifier: CB03666
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4405bf-8d5a-585e-99de-9525775a8b1d with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4405bf-8d5a-585e-99de-9525775a8b1d with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d4405bf-8d5a-585e-99de-9525775a8b1d, identifier: CB03666
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d4405bf-8d5a-585e-99de-9525775a8b1d with identifier: CB03666
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d4405bf-8d5a-585e-99de-9525775a8b1d with identifier: CB03666
2026-03-28 11:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1d4405bf-8d5a-585e-99de-9525775a8b1d with identifier: CB03666 to the API
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:58:39Z',
 'fuel_type': 'diesel',
 'id': '1d4405bf-8d5a-585e-99de-9525775a8b1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB03666',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 125655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CB03666%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Saving data for CB03666: {'auction_closing_time': 1774717119.0, 'created_time': 1774609348.455493, 'last_price_update_time': 1774695831.454248}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CB03666') HTTP/1.1" 204 0
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: WN15214
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: GP65825
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: KP85608
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: VU96042
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU96042%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Scrape type for VU96042: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c328bfa-8519-565e-85db-7ec4769e1332 with identifier: VU96042
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c328bfa-8519-565e-85db-7ec4769e1332 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c328bfa-8519-565e-85db-7ec4769e1332 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c328bfa-8519-565e-85db-7ec4769e1332, identifier: VU96042
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c328bfa-8519-565e-85db-7ec4769e1332 with identifier: VU96042
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c328bfa-8519-565e-85db-7ec4769e1332 with identifier: VU96042
2026-03-28 11:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c328bfa-8519-565e-85db-7ec4769e1332 with identifier: VU96042 to the API
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:37:26Z',
 'fuel_type': 'diesel',
 'id': '5c328bfa-8519-565e-85db-7ec4769e1332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU96042',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 100490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU96042%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Saving data for VU96042: {'auction_closing_time': 1774715846.0, 'created_time': 1773126745.058561, 'last_price_update_time': 1774695831.844821}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VU96042') HTTP/1.1" 204 0
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: TV36544
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: HF92394
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: AS08117
2026-03-28 11:03:51 [auto1.es] INFO: Found listing with ID: HT85667
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT85667%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [auto1.es] INFO: Scrape type for HT85667: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4df26b7-1bc4-56ac-98dc-c299f1a9b702, identifier: HT85667
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667
2026-03-28 11:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4df26b7-1bc4-56ac-98dc-c299f1a9b702 with identifier: HT85667 to the API
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:47Z',
 'fuel_type': 'diesel',
 'id': 'e4df26b7-1bc4-56ac-98dc-c299f1a9b702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85667',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 280790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Advanced edition',
 'transmission': 'automatic',
 'trim': 'quattro Advanced edition',
 'year': 2016}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT85667%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.es] INFO: Saving data for HT85667: {'auction_closing_time': 1774715147.0, 'created_time': 1773126989.972232, 'last_price_update_time': 1774695832.376453}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT85667') HTTP/1.1" 204 0
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: XN45249
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: HB38669
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB38669%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.es] INFO: Scrape type for HB38669: 0
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: HZ02297
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: UG78525
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: LK07555
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: XX98366
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX98366%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.es] INFO: Scrape type for XX98366: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af46a086-93d7-5ac9-b25f-351bf03ef09d with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af46a086-93d7-5ac9-b25f-351bf03ef09d with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af46a086-93d7-5ac9-b25f-351bf03ef09d, identifier: XX98366
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366
2026-03-28 11:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af46a086-93d7-5ac9-b25f-351bf03ef09d with identifier: XX98366 to the API
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:14:10Z',
 'fuel_type': 'diesel',
 'id': 'af46a086-93d7-5ac9-b25f-351bf03ef09d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX98366',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 211338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX98366%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.es] INFO: Saving data for XX98366: {'auction_closing_time': 1774714450.0, 'created_time': 1773132261.832281, 'last_price_update_time': 1774695832.810467}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX98366') HTTP/1.1" 204 0
2026-03-28 11:03:52 [auto1.es] INFO: Found listing with ID: DF08485
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF08485%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [auto1.es] INFO: Scrape type for DF08485: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 936fb343-d905-56a6-b0f8-b1930402f6d4 with identifier: DF08485
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 936fb343-d905-56a6-b0f8-b1930402f6d4 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 936fb343-d905-56a6-b0f8-b1930402f6d4 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 936fb343-d905-56a6-b0f8-b1930402f6d4, identifier: DF08485
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 936fb343-d905-56a6-b0f8-b1930402f6d4 with identifier: DF08485
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 936fb343-d905-56a6-b0f8-b1930402f6d4 with identifier: DF08485
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 936fb343-d905-56a6-b0f8-b1930402f6d4 with identifier: DF08485 to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:17:34Z',
 'fuel_type': 'diesel',
 'id': '936fb343-d905-56a6-b0f8-b1930402f6d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF08485',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 183212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Live Edition',
 'transmission': 'manual',
 'trim': 'Live Edition',
 'year': 2016}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF08485%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.es] INFO: Saving data for DF08485: {'auction_closing_time': 1774714654.0, 'created_time': 1774263678.485459, 'last_price_update_time': 1774695833.26123}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF08485') HTTP/1.1" 204 0
2026-03-28 11:03:53 [auto1.es] INFO: Found listing with ID: JC46060
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC46060%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.es] INFO: Scrape type for JC46060: 2
2026-03-28 11:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with identifier: JC46060
2026-03-28 11:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 456bf0d9-1379-52a9-8ba8-7be7dddcdd99, identifier: JC46060
2026-03-28 11:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with identifier: JC46060
2026-03-28 11:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with identifier: JC46060
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 456bf0d9-1379-52a9-8ba8-7be7dddcdd99 with identifier: JC46060 to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:05Z',
 'fuel_type': 'diesel',
 'id': '456bf0d9-1379-52a9-8ba8-7be7dddcdd99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC46060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 395420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Advance BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advance BlueMotion',
 'year': 2014}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC46060%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.es] INFO: Saving data for JC46060: {'auction_closing_time': 1774715765.0, 'created_time': 1773127553.94984, 'last_price_update_time': 1774695833.866977}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC46060') HTTP/1.1" 204 0
2026-03-28 11:03:53 [auto1.es] INFO: Found listing with ID: VT11458
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT11458%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [auto1.es] INFO: Scrape type for VT11458: 2
2026-03-28 11:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with identifier: VT11458
2026-03-28 11:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a, identifier: VT11458
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with identifier: VT11458
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with identifier: VT11458
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a with identifier: VT11458 to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:08:22Z',
 'fuel_type': 'diesel',
 'id': 'faacfdb7-4ae4-52cc-b6c3-7eaf5b461f3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT11458',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 236717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-30',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT11458%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.es] INFO: Saving data for VT11458: {'auction_closing_time': 1774714102.0, 'created_time': 1774274473.388649, 'last_price_update_time': 1774695834.347372}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT11458') HTTP/1.1" 204 0
2026-03-28 11:03:54 [auto1.es] INFO: Found listing with ID: VG77720
2026-03-28 11:03:54 [auto1.es] INFO: Found listing with ID: DL11284
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL11284%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.es] INFO: Scrape type for DL11284: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ab2045e-97e8-536d-a708-9b41531198fa with identifier: DL11284
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab2045e-97e8-536d-a708-9b41531198fa with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ab2045e-97e8-536d-a708-9b41531198fa with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ab2045e-97e8-536d-a708-9b41531198fa, identifier: DL11284
2026-03-28 11:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ab2045e-97e8-536d-a708-9b41531198fa with identifier: DL11284
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ab2045e-97e8-536d-a708-9b41531198fa with identifier: DL11284
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3ab2045e-97e8-536d-a708-9b41531198fa with identifier: DL11284 to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:15:23Z',
 'fuel_type': 'petrol',
 'id': '3ab2045e-97e8-536d-a708-9b41531198fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL11284',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 58785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-28',
 'seller_name': None,
 'title': 'Hyundai Getz 1.1 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2005}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL11284%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.es] INFO: Saving data for DL11284: {'auction_closing_time': 1774714523.0, 'created_time': 1773486026.630179, 'last_price_update_time': 1774695834.792888}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL11284') HTTP/1.1" 204 0
2026-03-28 11:03:54 [auto1.es] INFO: Found listing with ID: YV30906
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV30906%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [auto1.es] INFO: Scrape type for YV30906: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b933b4f-658d-5731-8958-56f7c7823b18 with identifier: YV30906
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b933b4f-658d-5731-8958-56f7c7823b18 with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b933b4f-658d-5731-8958-56f7c7823b18 with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b933b4f-658d-5731-8958-56f7c7823b18, identifier: YV30906
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b933b4f-658d-5731-8958-56f7c7823b18 with identifier: YV30906
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b933b4f-658d-5731-8958-56f7c7823b18 with identifier: YV30906
2026-03-28 11:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b933b4f-658d-5731-8958-56f7c7823b18 with identifier: YV30906 to the API
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:12Z',
 'fuel_type': 'diesel',
 'id': '1b933b4f-658d-5731-8958-56f7c7823b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV30906',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 159758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-27',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi VTR Plus',
 'transmission': 'manual',
 'trim': 'VTR Plus',
 'year': 2005}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV30906%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Saving data for YV30906: {'auction_closing_time': 1774716852.0, 'created_time': 1773131872.690804, 'last_price_update_time': 1774695835.219109}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YV30906') HTTP/1.1" 204 0
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: DL05579
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: UK08613
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: AZ15880
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ15880%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Scrape type for AZ15880: 0
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: EV24986
2026-03-28 11:03:55 [auto1.es] INFO: Channel: 24h | Page: 59 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: HA22815
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA22815%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Scrape type for HA22815: 0
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: RK55405
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: UG21171
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: ME07403
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: MF36359
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: ES15520
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES15520%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Scrape type for ES15520: 2
2026-03-28 11:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with identifier: ES15520
2026-03-28 11:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b03b1c6e-74cf-5a64-9f7a-776110cbd2e0, identifier: ES15520
2026-03-28 11:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with identifier: ES15520
2026-03-28 11:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with identifier: ES15520
2026-03-28 11:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b03b1c6e-74cf-5a64-9f7a-776110cbd2e0 with identifier: ES15520 to the API
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:41:06Z',
 'fuel_type': 'diesel',
 'id': 'b03b1c6e-74cf-5a64-9f7a-776110cbd2e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES15520',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 298133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-11',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2005}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES15520%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Saving data for ES15520: {'auction_closing_time': 1774716066.0, 'created_time': 1773129408.730329, 'last_price_update_time': 1774695835.697563}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES15520') HTTP/1.1" 204 0
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: HP01859
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: CP49442
2026-03-28 11:03:55 [auto1.es] INFO: Found listing with ID: TC70621
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC70621%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [auto1.es] INFO: Scrape type for TC70621: 2
2026-03-28 11:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-03-28 11:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa2f0120-01b1-52d6-a2b4-91a67bf87e02, identifier: TC70621
2026-03-28 11:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-03-28 11:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa2f0120-01b1-52d6-a2b4-91a67bf87e02 with identifier: TC70621 to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:47:29Z',
 'fuel_type': 'petrol',
 'id': 'fa2f0120-01b1-52d6-a2b4-91a67bf87e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC70621',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 89780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-09',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC70621%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.es] INFO: Saving data for TC70621: {'auction_closing_time': 1774716449.0, 'created_time': 1773127467.696859, 'last_price_update_time': 1774695836.248918}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TC70621') HTTP/1.1" 204 0
2026-03-28 11:03:56 [auto1.es] INFO: Found listing with ID: LG93188
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG93188%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.es] INFO: Scrape type for LG93188: 2
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac215c02-ddff-5997-b77e-fb39ff17dba2 with identifier: LG93188
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac215c02-ddff-5997-b77e-fb39ff17dba2 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac215c02-ddff-5997-b77e-fb39ff17dba2 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac215c02-ddff-5997-b77e-fb39ff17dba2, identifier: LG93188
2026-03-28 11:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac215c02-ddff-5997-b77e-fb39ff17dba2 with identifier: LG93188
2026-03-28 11:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac215c02-ddff-5997-b77e-fb39ff17dba2 with identifier: LG93188
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac215c02-ddff-5997-b77e-fb39ff17dba2 with identifier: LG93188 to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:30Z',
 'fuel_type': 'petrol',
 'id': 'ac215c02-ddff-5997-b77e-fb39ff17dba2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG93188',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 35292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG93188%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.es] INFO: Saving data for LG93188: {'auction_closing_time': 1774715730.0, 'created_time': 1773128850.793599, 'last_price_update_time': 1774695836.670292}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG93188') HTTP/1.1" 204 0
2026-03-28 11:03:56 [auto1.es] INFO: Found listing with ID: MY48214
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY48214%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [auto1.es] INFO: Scrape type for MY48214: 2
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with identifier: MY48214
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53, identifier: MY48214
2026-03-28 11:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with identifier: MY48214
2026-03-28 11:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with identifier: MY48214
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53 with identifier: MY48214 to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:21Z',
 'fuel_type': 'diesel',
 'id': '75eac8f8-9c6a-5c7f-8f1e-8fc4babc8f53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY48214',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 335287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-18',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY48214%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.es] INFO: Saving data for MY48214: {'auction_closing_time': 1774713861.0, 'created_time': 1774296184.341389, 'last_price_update_time': 1774695837.121018}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY48214') HTTP/1.1" 204 0
2026-03-28 11:03:57 [auto1.es] INFO: Found listing with ID: ZJ52163
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ52163%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.es] INFO: Scrape type for ZJ52163: 2
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with identifier: ZJ52163
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb1ff7d5-6c92-571f-bfc7-7e4cb7421023, identifier: ZJ52163
2026-03-28 11:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with identifier: ZJ52163
2026-03-28 11:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with identifier: ZJ52163
2026-03-28 11:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb1ff7d5-6c92-571f-bfc7-7e4cb7421023 with identifier: ZJ52163 to the API
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:34:24Z',
 'fuel_type': 'petrol',
 'id': 'eb1ff7d5-6c92-571f-bfc7-7e4cb7421023',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ52163',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 121403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ52163%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.es] INFO: Saving data for ZJ52163: {'auction_closing_time': 1774715664.0, 'created_time': 1772626600.795807, 'last_price_update_time': 1774695837.659791}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ52163') HTTP/1.1" 204 0
2026-03-28 11:03:57 [auto1.es] INFO: Found listing with ID: VY31603
2026-03-28 11:03:57 [auto1.es] INFO: Found listing with ID: WC85393
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC85393%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [auto1.es] INFO: Scrape type for WC85393: 2
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with identifier: WC85393
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with scrape type 2
2026-03-28 11:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a3dd4ad-1b02-57fd-b580-a52916cd9974, identifier: WC85393
2026-03-28 11:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with identifier: WC85393
2026-03-28 11:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with identifier: WC85393
2026-03-28 11:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a3dd4ad-1b02-57fd-b580-a52916cd9974 with identifier: WC85393 to the API
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:31:06Z',
 'fuel_type': 'petrol',
 'id': '8a3dd4ad-1b02-57fd-b580-a52916cd9974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC85393',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 191346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC85393%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.es] INFO: Saving data for WC85393: {'auction_closing_time': 1774715466.0, 'created_time': 1774296168.607955, 'last_price_update_time': 1774695838.06725}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WC85393') HTTP/1.1" 204 0
2026-03-28 11:03:58 [auto1.es] INFO: Found listing with ID: TG12231
2026-03-28 11:03:58 [auto1.es] INFO: Found listing with ID: VK38327
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK38327%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.es] INFO: Scrape type for VK38327: 2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with identifier: VK38327
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239, identifier: VK38327
2026-03-28 11:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with identifier: VK38327
2026-03-28 11:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with identifier: VK38327
2026-03-28 11:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d835f51-26a6-5ad3-a52c-ae6ff8dfc239 with identifier: VK38327 to the API
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:40Z',
 'fuel_type': 'petrol',
 'id': '0d835f51-26a6-5ad3-a52c-ae6ff8dfc239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK38327',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 288199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-13',
 'seller_name': None,
 'title': 'BMW 3er 320i Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK38327%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.es] INFO: Saving data for VK38327: {'auction_closing_time': 1774716040.0, 'created_time': 1773843017.856232, 'last_price_update_time': 1774695838.485398}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK38327') HTTP/1.1" 204 0
2026-03-28 11:03:58 [auto1.es] INFO: Found listing with ID: ZJ67299
2026-03-28 11:03:58 [auto1.es] INFO: Found listing with ID: TZ36663
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ36663%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.es] INFO: Scrape type for TZ36663: 2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc996538-8463-590a-86c3-df48243a3b64 with identifier: TZ36663
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc996538-8463-590a-86c3-df48243a3b64 with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc996538-8463-590a-86c3-df48243a3b64 with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc996538-8463-590a-86c3-df48243a3b64, identifier: TZ36663
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc996538-8463-590a-86c3-df48243a3b64 with identifier: TZ36663
2026-03-28 11:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc996538-8463-590a-86c3-df48243a3b64 with identifier: TZ36663
2026-03-28 11:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc996538-8463-590a-86c3-df48243a3b64 with identifier: TZ36663 to the API
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:55:08Z',
 'fuel_type': 'petrol',
 'id': 'bc996538-8463-590a-86c3-df48243a3b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ36663',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 118030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-11',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TZ36663%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [auto1.es] INFO: Saving data for TZ36663: {'auction_closing_time': 1774716908.0, 'created_time': 1773130576.022331, 'last_price_update_time': 1774695838.917991}
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TZ36663') HTTP/1.1" 204 0
2026-03-28 11:03:59 [auto1.es] INFO: Found listing with ID: WP66264
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP66264%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.es] INFO: Scrape type for WP66264: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa73e497-5a6e-5523-a43c-6c64114801d8 with identifier: WP66264
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa73e497-5a6e-5523-a43c-6c64114801d8 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa73e497-5a6e-5523-a43c-6c64114801d8 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa73e497-5a6e-5523-a43c-6c64114801d8, identifier: WP66264
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa73e497-5a6e-5523-a43c-6c64114801d8 with identifier: WP66264
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa73e497-5a6e-5523-a43c-6c64114801d8 with identifier: WP66264
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa73e497-5a6e-5523-a43c-6c64114801d8 with identifier: WP66264 to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'diesel',
 'id': 'fa73e497-5a6e-5523-a43c-6c64114801d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP66264',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Connect',
 'odometer': 242282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-27',
 'seller_name': None,
 'title': 'Ford Tourneo Connect 1.8 TDCi Kombi lang',
 'transmission': 'manual',
 'trim': 'Kombi lang',
 'year': 2007}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP66264%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.es] INFO: Saving data for WP66264: {'auction_closing_time': 1774715736.0, 'created_time': 1773132502.746655, 'last_price_update_time': 1774695839.445302}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WP66264') HTTP/1.1" 204 0
2026-03-28 11:03:59 [auto1.es] INFO: Found listing with ID: GR19122
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR19122%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.es] INFO: Scrape type for GR19122: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d62994-612f-57b8-a506-3f0525e38096 with identifier: GR19122
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d62994-612f-57b8-a506-3f0525e38096 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d62994-612f-57b8-a506-3f0525e38096 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4d62994-612f-57b8-a506-3f0525e38096, identifier: GR19122
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4d62994-612f-57b8-a506-3f0525e38096 with identifier: GR19122
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4d62994-612f-57b8-a506-3f0525e38096 with identifier: GR19122
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e4d62994-612f-57b8-a506-3f0525e38096 with identifier: GR19122 to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'diesel',
 'id': 'e4d62994-612f-57b8-a506-3f0525e38096',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR19122',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 172826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2017}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR19122%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.es] INFO: Saving data for GR19122: {'auction_closing_time': 1774715706.0, 'created_time': 1773127331.738214, 'last_price_update_time': 1774695839.850693}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR19122') HTTP/1.1" 204 0
2026-03-28 11:03:59 [auto1.es] INFO: Channel: 24h | Page: 60 | totalHits: 2554 | hits on page: 40
2026-03-28 11:03:59 [auto1.es] INFO: Found listing with ID: EB62750
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB62750%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [auto1.es] INFO: Scrape type for EB62750: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec12fcc6-583d-5f79-a171-f1406c01e18e with identifier: EB62750
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec12fcc6-583d-5f79-a171-f1406c01e18e with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec12fcc6-583d-5f79-a171-f1406c01e18e with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ec12fcc6-583d-5f79-a171-f1406c01e18e, identifier: EB62750
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ec12fcc6-583d-5f79-a171-f1406c01e18e with identifier: EB62750
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ec12fcc6-583d-5f79-a171-f1406c01e18e with identifier: EB62750
2026-03-28 11:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ec12fcc6-583d-5f79-a171-f1406c01e18e with identifier: EB62750 to the API
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:34Z',
 'fuel_type': 'diesel',
 'id': 'ec12fcc6-583d-5f79-a171-f1406c01e18e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB62750',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 190812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB62750%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.es] INFO: Saving data for EB62750: {'auction_closing_time': 1774714234.0, 'created_time': 1773131201.131299, 'last_price_update_time': 1774695840.327965}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB62750') HTTP/1.1" 204 0
2026-03-28 11:04:00 [auto1.es] INFO: Found listing with ID: ZW95177
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW95177%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.es] INFO: Scrape type for ZW95177: 2
2026-03-28 11:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a10264c4-88a6-505a-a8e0-4caae20bed4a with identifier: ZW95177
2026-03-28 11:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a10264c4-88a6-505a-a8e0-4caae20bed4a with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a10264c4-88a6-505a-a8e0-4caae20bed4a with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a10264c4-88a6-505a-a8e0-4caae20bed4a, identifier: ZW95177
2026-03-28 11:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:00 [auto1.es] INFO: Found listing with ID: BZ21450
2026-03-28 11:04:00 [auto1.es] INFO: Found listing with ID: XY10294
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY10294%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [auto1.es] INFO: Scrape type for XY10294: 2
2026-03-28 11:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72da616d-bad3-5604-b09c-60a5d65c69fa with identifier: XY10294
2026-03-28 11:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72da616d-bad3-5604-b09c-60a5d65c69fa with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72da616d-bad3-5604-b09c-60a5d65c69fa with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72da616d-bad3-5604-b09c-60a5d65c69fa, identifier: XY10294
2026-03-28 11:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a10264c4-88a6-505a-a8e0-4caae20bed4a with identifier: ZW95177
2026-03-28 11:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a10264c4-88a6-505a-a8e0-4caae20bed4a with identifier: ZW95177
2026-03-28 11:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a10264c4-88a6-505a-a8e0-4caae20bed4a with identifier: ZW95177 to the API
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:58:20Z',
 'fuel_type': 'diesel',
 'id': 'a10264c4-88a6-505a-a8e0-4caae20bed4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW95177',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 159358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW95177%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.es] INFO: Saving data for ZW95177: {'auction_closing_time': 1774717100.0, 'created_time': 1773132523.745075, 'last_price_update_time': 1774695841.078821}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZW95177') HTTP/1.1" 204 0
2026-03-28 11:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72da616d-bad3-5604-b09c-60a5d65c69fa with identifier: XY10294
2026-03-28 11:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72da616d-bad3-5604-b09c-60a5d65c69fa with identifier: XY10294
2026-03-28 11:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 72da616d-bad3-5604-b09c-60a5d65c69fa with identifier: XY10294 to the API
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:35:02Z',
 'fuel_type': 'diesel',
 'id': '72da616d-bad3-5604-b09c-60a5d65c69fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY10294',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 233849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY10294%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.es] INFO: Saving data for XY10294: {'auction_closing_time': 1774715702.0, 'created_time': 1773132243.949285, 'last_price_update_time': 1774695841.653445}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XY10294') HTTP/1.1" 204 0
2026-03-28 11:04:01 [auto1.es] INFO: Found listing with ID: XX72262
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX72262%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.es] INFO: Scrape type for XX72262: 2
2026-03-28 11:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce758bc9-cc25-5921-b93d-1ff98dc98f15 with identifier: XX72262
2026-03-28 11:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce758bc9-cc25-5921-b93d-1ff98dc98f15 with scrape type 2
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce758bc9-cc25-5921-b93d-1ff98dc98f15 with scrape type 2
2026-03-28 11:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce758bc9-cc25-5921-b93d-1ff98dc98f15, identifier: XX72262
2026-03-28 11:04:01 [auto1.es] INFO: Found listing with ID: LG59471
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG59471%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [auto1.es] INFO: Scrape type for LG59471: 2
2026-03-28 11:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with identifier: LG59471
2026-03-28 11:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with scrape type 2
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with scrape type 2
2026-03-28 11:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4c3d4a98-8426-54ae-90cd-7abfafafaa24, identifier: LG59471
2026-03-28 11:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce758bc9-cc25-5921-b93d-1ff98dc98f15 with identifier: XX72262
2026-03-28 11:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce758bc9-cc25-5921-b93d-1ff98dc98f15 with identifier: XX72262
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce758bc9-cc25-5921-b93d-1ff98dc98f15 with identifier: XX72262 to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:51Z',
 'fuel_type': 'diesel',
 'id': 'ce758bc9-cc25-5921-b93d-1ff98dc98f15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX72262',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 291223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX72262%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Saving data for XX72262: {'auction_closing_time': 1774715931.0, 'created_time': 1774609386.64548, 'last_price_update_time': 1774695842.204497}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX72262') HTTP/1.1" 204 0
2026-03-28 11:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with identifier: LG59471
2026-03-28 11:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with identifier: LG59471
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4c3d4a98-8426-54ae-90cd-7abfafafaa24 with identifier: LG59471 to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:39:11Z',
 'fuel_type': 'diesel',
 'id': '4c3d4a98-8426-54ae-90cd-7abfafafaa24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG59471',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 73362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2008}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LG59471%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Saving data for LG59471: {'auction_closing_time': 1774715951.0, 'created_time': 1773475228.148018, 'last_price_update_time': 1774695842.502968}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LG59471') HTTP/1.1" 204 0
2026-03-28 11:04:02 [auto1.es] INFO: Found listing with ID: EH39769
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH39769%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Scrape type for EH39769: 0
2026-03-28 11:04:02 [auto1.es] INFO: Found listing with ID: LG94479
2026-03-28 11:04:02 [auto1.es] INFO: Found listing with ID: VT96833
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT96833%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Scrape type for VT96833: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with identifier: VT96833
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71ac45a5-b44d-5961-9f0b-6a75beb0a64d, identifier: VT96833
2026-03-28 11:04:02 [auto1.es] INFO: Found listing with ID: RV14480
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV14480%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Scrape type for RV14480: 0
2026-03-28 11:04:02 [auto1.es] INFO: Found listing with ID: ZC21665
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [auto1.es] INFO: Scrape type for ZC21665: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with identifier: ZC21665
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 87b1d2bc-2310-5c26-bef5-7bc96c7ad362, identifier: ZC21665
2026-03-28 11:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with identifier: VT96833
2026-03-28 11:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with identifier: VT96833
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71ac45a5-b44d-5961-9f0b-6a75beb0a64d with identifier: VT96833 to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:04:29Z',
 'fuel_type': 'petrol',
 'id': '71ac45a5-b44d-5961-9f0b-6a75beb0a64d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT96833',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 123849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT96833%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.es] INFO: Saving data for VT96833: {'auction_closing_time': 1774713869.0, 'created_time': 1773820830.620485, 'last_price_update_time': 1774695843.093066}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT96833') HTTP/1.1" 204 0
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with identifier: ZC21665
2026-03-28 11:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with identifier: ZC21665
2026-03-28 11:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 87b1d2bc-2310-5c26-bef5-7bc96c7ad362 with identifier: ZC21665 to the API
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:24:01Z',
 'fuel_type': 'diesel',
 'id': '87b1d2bc-2310-5c26-bef5-7bc96c7ad362',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC21665',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 206293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC21665%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.es] INFO: Saving data for ZC21665: {'auction_closing_time': 1774715041.0, 'created_time': 1773126719.117411, 'last_price_update_time': 1774695843.481716}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC21665') HTTP/1.1" 204 0
2026-03-28 11:04:03 [auto1.es] INFO: Found listing with ID: UR64839
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR64839%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.es] INFO: Scrape type for UR64839: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e3166c3-75ef-54d7-bbe2-047dcb807855 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e3166c3-75ef-54d7-bbe2-047dcb807855 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e3166c3-75ef-54d7-bbe2-047dcb807855, identifier: UR64839
2026-03-28 11:04:03 [auto1.es] INFO: Found listing with ID: FA71297
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA71297%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [auto1.es] INFO: Scrape type for FA71297: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f1b9da-a418-56f8-b590-87905f7b6612 with identifier: FA71297
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5f1b9da-a418-56f8-b590-87905f7b6612 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5f1b9da-a418-56f8-b590-87905f7b6612 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5f1b9da-a418-56f8-b590-87905f7b6612, identifier: FA71297
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-03-28 11:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839
2026-03-28 11:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2e3166c3-75ef-54d7-bbe2-047dcb807855 with identifier: UR64839 to the API
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:35:25Z',
 'fuel_type': 'petrol',
 'id': '2e3166c3-75ef-54d7-bbe2-047dcb807855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR64839',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 109088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UR64839%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.es] INFO: Saving data for UR64839: {'auction_closing_time': 1774715725.0, 'created_time': 1773691520.305139, 'last_price_update_time': 1774695844.00992}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UR64839') HTTP/1.1" 204 0
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5f1b9da-a418-56f8-b590-87905f7b6612 with identifier: FA71297
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5f1b9da-a418-56f8-b590-87905f7b6612 with identifier: FA71297
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d5f1b9da-a418-56f8-b590-87905f7b6612 with identifier: FA71297 to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:58:04Z',
 'fuel_type': 'diesel',
 'id': 'd5f1b9da-a418-56f8-b590-87905f7b6612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA71297',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 117500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-27',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi ST Confort',
 'transmission': 'manual',
 'trim': 'ST Confort',
 'year': 2004}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA71297%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.es] INFO: Saving data for FA71297: {'auction_closing_time': 1774717084.0, 'created_time': 1773129407.102219, 'last_price_update_time': 1774695844.327477}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA71297') HTTP/1.1" 204 0
2026-03-28 11:04:04 [auto1.es] INFO: Found listing with ID: TR96675
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96675%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.es] INFO: Scrape type for TR96675: 2
2026-03-28 11:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe615b52-a213-5e20-954b-b8f2276de4e2 with identifier: TR96675
2026-03-28 11:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe615b52-a213-5e20-954b-b8f2276de4e2 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe615b52-a213-5e20-954b-b8f2276de4e2 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe615b52-a213-5e20-954b-b8f2276de4e2, identifier: TR96675
2026-03-28 11:04:04 [auto1.es] INFO: Found listing with ID: VL09919
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL09919%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.es] INFO: Scrape type for VL09919: 2
2026-03-28 11:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb22e554-a337-5b23-93f8-e3554505dc93 with identifier: VL09919
2026-03-28 11:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb22e554-a337-5b23-93f8-e3554505dc93 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb22e554-a337-5b23-93f8-e3554505dc93 with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb22e554-a337-5b23-93f8-e3554505dc93, identifier: VL09919
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe615b52-a213-5e20-954b-b8f2276de4e2 with identifier: TR96675
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe615b52-a213-5e20-954b-b8f2276de4e2 with identifier: TR96675
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe615b52-a213-5e20-954b-b8f2276de4e2 with identifier: TR96675 to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:16:14Z',
 'fuel_type': 'diesel',
 'id': 'fe615b52-a213-5e20-954b-b8f2276de4e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR96675',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 94146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR96675%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [auto1.es] INFO: Saving data for TR96675: {'auction_closing_time': 1774714574.0, 'created_time': 1774296078.961677, 'last_price_update_time': 1774695844.844153}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR96675') HTTP/1.1" 204 0
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb22e554-a337-5b23-93f8-e3554505dc93 with identifier: VL09919
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb22e554-a337-5b23-93f8-e3554505dc93 with identifier: VL09919
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb22e554-a337-5b23-93f8-e3554505dc93 with identifier: VL09919 to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:24:07Z',
 'fuel_type': 'diesel',
 'id': 'bb22e554-a337-5b23-93f8-e3554505dc93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL09919',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 232672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-19',
 'seller_name': None,
 'title': 'Citroen C4 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2021}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL09919%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.es] INFO: Saving data for VL09919: {'auction_closing_time': 1774715047.0, 'created_time': 1774274509.56296, 'last_price_update_time': 1774695845.161735}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VL09919') HTTP/1.1" 204 0
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: KP83247
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: LC59267
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59267%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.es] INFO: Scrape type for LC59267: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f9e757-989f-5474-b8a7-4313eacefcac with identifier: LC59267
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f9e757-989f-5474-b8a7-4313eacefcac with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f9e757-989f-5474-b8a7-4313eacefcac with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 89f9e757-989f-5474-b8a7-4313eacefcac, identifier: LC59267
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: HE42254
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: RK09701
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: TV36726
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: GE62108
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: ZH45296
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: WZ44927
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: LP80713
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP80713%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.es] INFO: Scrape type for LP80713: 0
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: DM84841
2026-03-28 11:04:05 [auto1.es] INFO: Found listing with ID: MZ44217
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ44217%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.es] INFO: Scrape type for MZ44217: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2be916-ec17-59cb-b521-57cca7d9fb07 with identifier: MZ44217
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2be916-ec17-59cb-b521-57cca7d9fb07 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2be916-ec17-59cb-b521-57cca7d9fb07 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d2be916-ec17-59cb-b521-57cca7d9fb07, identifier: MZ44217
2026-03-28 11:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 89f9e757-989f-5474-b8a7-4313eacefcac with identifier: LC59267
2026-03-28 11:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 89f9e757-989f-5474-b8a7-4313eacefcac with identifier: LC59267
2026-03-28 11:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 89f9e757-989f-5474-b8a7-4313eacefcac with identifier: LC59267 to the API
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:23Z',
 'fuel_type': 'petrol',
 'id': '89f9e757-989f-5474-b8a7-4313eacefcac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC59267',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 173182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2016}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC59267%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [auto1.es] INFO: Saving data for LC59267: {'auction_closing_time': 1774714223.0, 'created_time': 1773842989.342114, 'last_price_update_time': 1774695845.714308}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC59267') HTTP/1.1" 204 0
2026-03-28 11:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d2be916-ec17-59cb-b521-57cca7d9fb07 with identifier: MZ44217
2026-03-28 11:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d2be916-ec17-59cb-b521-57cca7d9fb07 with identifier: MZ44217
2026-03-28 11:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3d2be916-ec17-59cb-b521-57cca7d9fb07 with identifier: MZ44217 to the API
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:51:37Z',
 'fuel_type': 'petrol',
 'id': '3d2be916-ec17-59cb-b521-57cca7d9fb07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ44217',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 236978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-01-07',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ44217%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Saving data for MZ44217: {'auction_closing_time': 1774716697.0, 'created_time': 1774296177.174858, 'last_price_update_time': 1774695846.115104}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ44217') HTTP/1.1" 204 0
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: DV40298
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV40298%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Scrape type for DV40298: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d43842ab-152c-5aba-872a-bb6a49f17473 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d43842ab-152c-5aba-872a-bb6a49f17473 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d43842ab-152c-5aba-872a-bb6a49f17473, identifier: DV40298
2026-03-28 11:04:06 [scrapy.extensions.logstats] INFO: Crawled 176 pages (at 8 pages/min), scraped 204 items (at 127 items/min)
2026-03-28 11:04:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: DH50359
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: NJ73279
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: GM08675
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298
2026-03-28 11:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d43842ab-152c-5aba-872a-bb6a49f17473 with identifier: DV40298 to the API
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:50:26Z',
 'fuel_type': 'diesel',
 'id': 'd43842ab-152c-5aba-872a-bb6a49f17473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV40298',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 155682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-05',
 'seller_name': None,
 'title': 'Opel Astra 2.0 CDTI Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2015}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV40298%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Saving data for DV40298: {'auction_closing_time': 1774716626.0, 'created_time': 1774296066.989794, 'last_price_update_time': 1774695846.531978}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV40298') HTTP/1.1" 204 0
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: DD46195
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD46195%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Scrape type for DD46195: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9410c0cb-0471-58d9-a676-cadee62c927e with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9410c0cb-0471-58d9-a676-cadee62c927e with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9410c0cb-0471-58d9-a676-cadee62c927e, identifier: DD46195
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195
2026-03-28 11:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9410c0cb-0471-58d9-a676-cadee62c927e with identifier: DD46195 to the API
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:21:48Z',
 'fuel_type': 'petrol',
 'id': '9410c0cb-0471-58d9-a676-cadee62c927e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD46195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 82937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.5 TSI ACT Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2018}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD46195%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Saving data for DD46195: {'auction_closing_time': 1774714908.0, 'created_time': 1774015845.745586, 'last_price_update_time': 1774695846.951539}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD46195') HTTP/1.1" 204 0
2026-03-28 11:04:06 [auto1.es] INFO: Found listing with ID: VB81501
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB81501%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [auto1.es] INFO: Scrape type for VB81501: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45909512-f005-56ed-b952-5cae255ea468 with identifier: VB81501
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45909512-f005-56ed-b952-5cae255ea468 with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45909512-f005-56ed-b952-5cae255ea468 with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45909512-f005-56ed-b952-5cae255ea468, identifier: VB81501
2026-03-28 11:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45909512-f005-56ed-b952-5cae255ea468 with identifier: VB81501
2026-03-28 11:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45909512-f005-56ed-b952-5cae255ea468 with identifier: VB81501
2026-03-28 11:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45909512-f005-56ed-b952-5cae255ea468 with identifier: VB81501 to the API
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:58:12Z',
 'fuel_type': 'diesel',
 'id': '45909512-f005-56ed-b952-5cae255ea468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB81501',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 253137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2011}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB81501%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.es] INFO: Saving data for VB81501: {'auction_closing_time': 1774717092.0, 'created_time': 1772628478.686173, 'last_price_update_time': 1774695847.44609}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB81501') HTTP/1.1" 204 0
2026-03-28 11:04:07 [auto1.es] INFO: Found listing with ID: HN11800
2026-03-28 11:04:07 [auto1.es] INFO: Found listing with ID: GH42664
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH42664%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.es] INFO: Scrape type for GH42664: 2
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with identifier: GH42664
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7dfd044-d112-50ab-9c1d-3a4bfe2b497b, identifier: GH42664
2026-03-28 11:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with identifier: GH42664
2026-03-28 11:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with identifier: GH42664
2026-03-28 11:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7dfd044-d112-50ab-9c1d-3a4bfe2b497b with identifier: GH42664 to the API
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:59:53Z',
 'fuel_type': 'diesel',
 'id': 'b7dfd044-d112-50ab-9c1d-3a4bfe2b497b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH42664',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 75093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-24',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi GT-Style',
 'transmission': 'manual',
 'trim': 'GT-Style',
 'year': 2014}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH42664%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.es] INFO: Saving data for GH42664: {'auction_closing_time': 1774717193.0, 'created_time': 1774296366.638115, 'last_price_update_time': 1774695847.854858}
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH42664') HTTP/1.1" 204 0
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:07 [auto1.es] INFO: Found listing with ID: UV08458
2026-03-28 11:04:07 [auto1.es] INFO: Found listing with ID: BB29813
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB29813%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [auto1.es] INFO: Scrape type for BB29813: 2
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121e4ee8-7aeb-5548-a248-ba0d19817f53 with identifier: BB29813
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121e4ee8-7aeb-5548-a248-ba0d19817f53 with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121e4ee8-7aeb-5548-a248-ba0d19817f53 with scrape type 2
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 121e4ee8-7aeb-5548-a248-ba0d19817f53, identifier: BB29813
2026-03-28 11:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 121e4ee8-7aeb-5548-a248-ba0d19817f53 with identifier: BB29813
2026-03-28 11:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 121e4ee8-7aeb-5548-a248-ba0d19817f53 with identifier: BB29813
2026-03-28 11:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 121e4ee8-7aeb-5548-a248-ba0d19817f53 with identifier: BB29813 to the API
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:42Z',
 'fuel_type': 'diesel',
 'id': '121e4ee8-7aeb-5548-a248-ba0d19817f53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB29813',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 207768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-31',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB29813%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.es] INFO: Saving data for BB29813: {'auction_closing_time': 1774716642.0, 'created_time': 1774296257.772568, 'last_price_update_time': 1774695848.262866}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB29813') HTTP/1.1" 204 0
2026-03-28 11:04:08 [auto1.es] INFO: Found listing with ID: DD02198
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02198%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.es] INFO: Scrape type for DD02198: 2
2026-03-28 11:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with identifier: DD02198
2026-03-28 11:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e, identifier: DD02198
2026-03-28 11:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with identifier: DD02198
2026-03-28 11:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with identifier: DD02198
2026-03-28 11:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e with identifier: DD02198 to the API
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:31:31Z',
 'fuel_type': 'diesel',
 'id': '3e4e4dde-d3ae-5d5c-9f06-de58fcb46d2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD02198',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 284424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-11',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2015}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD02198%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.es] INFO: Saving data for DD02198: {'auction_closing_time': 1774715491.0, 'created_time': 1773130898.887281, 'last_price_update_time': 1774695848.667912}
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD02198') HTTP/1.1" 204 0
2026-03-28 11:04:08 [auto1.es] INFO: Channel: 24h | Page: 61 | totalHits: 2554 | hits on page: 40
2026-03-28 11:04:08 [auto1.es] INFO: Found listing with ID: SM77284
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM77284%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [auto1.es] INFO: Scrape type for SM77284: 2
2026-03-28 11:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518a0364-4095-59f9-940d-d2bf763fb581 with identifier: SM77284
2026-03-28 11:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518a0364-4095-59f9-940d-d2bf763fb581 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518a0364-4095-59f9-940d-d2bf763fb581 with scrape type 2
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 518a0364-4095-59f9-940d-d2bf763fb581, identifier: SM77284
2026-03-28 11:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 518a0364-4095-59f9-940d-d2bf763fb581 with identifier: SM77284
2026-03-28 11:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 518a0364-4095-59f9-940d-d2bf763fb581 with identifier: SM77284
2026-03-28 11:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 518a0364-4095-59f9-940d-d2bf763fb581 with identifier: SM77284 to the API
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:35:51Z',
 'fuel_type': 'diesel',
 'id': '518a0364-4095-59f9-940d-d2bf763fb581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM77284',
 'listing': 'auction',
 'make': 'Tata',
 'model': 'Indigo',
 'odometer': 69641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-02',
 'seller_name': None,
 'title': 'Tata Indigo 1.4 Turbodiesel LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2009}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM77284%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.es] INFO: Saving data for SM77284: {'auction_closing_time': 1774715751.0, 'created_time': 1773129430.36032, 'last_price_update_time': 1774695849.207739}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM77284') HTTP/1.1" 204 0
2026-03-28 11:04:09 [auto1.es] INFO: Found listing with ID: FT33215
2026-03-28 11:04:09 [auto1.es] INFO: Found listing with ID: CB32241
2026-03-28 11:04:09 [auto1.es] INFO: Found listing with ID: DX86055
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX86055%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.es] INFO: Scrape type for DX86055: 2
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a045de21-085e-54fd-8584-add49176ee20 with identifier: DX86055
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a045de21-085e-54fd-8584-add49176ee20 with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a045de21-085e-54fd-8584-add49176ee20 with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a045de21-085e-54fd-8584-add49176ee20, identifier: DX86055
2026-03-28 11:04:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:09 [auto1.es] INFO: Found listing with ID: XS23007
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS23007%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.es] INFO: Scrape type for XS23007: 2
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with identifier: XS23007
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with scrape type 2
2026-03-28 11:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b, identifier: XS23007
2026-03-28 11:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a045de21-085e-54fd-8584-add49176ee20 with identifier: DX86055
2026-03-28 11:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a045de21-085e-54fd-8584-add49176ee20 with identifier: DX86055
2026-03-28 11:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a045de21-085e-54fd-8584-add49176ee20 with identifier: DX86055 to the API
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:47:32Z',
 'fuel_type': 'diesel',
 'id': 'a045de21-085e-54fd-8584-add49176ee20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX86055',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 222916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-19',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX86055%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [auto1.es] INFO: Saving data for DX86055: {'auction_closing_time': 1774716452.0, 'created_time': 1774296041.72788, 'last_price_update_time': 1774695849.720894}
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX86055') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with identifier: XS23007
2026-03-28 11:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with identifier: XS23007
2026-03-28 11:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b with identifier: XS23007 to the API
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-28T16:19:55Z',
 'fuel_type': 'petrol',
 'id': 'b126f0a0-fad9-5c0d-b58c-8ff220a6ce2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS23007',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 414524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS23007%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Saving data for XS23007: {'auction_closing_time': 1774714795.0, 'created_time': 1773691524.480197, 'last_price_update_time': 1774695850.041413}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS23007') HTTP/1.1" 204 0
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: KV41270
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV41270%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Scrape type for KV41270: 2
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 610840db-f57a-52c5-a4ea-0bd1863c29c4 with identifier: KV41270
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 610840db-f57a-52c5-a4ea-0bd1863c29c4 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 610840db-f57a-52c5-a4ea-0bd1863c29c4 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 610840db-f57a-52c5-a4ea-0bd1863c29c4, identifier: KV41270
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: TH31010
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH31010%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Scrape type for TH31010: 2
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617e54fb-56f1-5502-ae4e-325cb1081588 with identifier: TH31010
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e54fb-56f1-5502-ae4e-325cb1081588 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617e54fb-56f1-5502-ae4e-325cb1081588 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 617e54fb-56f1-5502-ae4e-325cb1081588, identifier: TH31010
2026-03-28 11:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 610840db-f57a-52c5-a4ea-0bd1863c29c4 with identifier: KV41270
2026-03-28 11:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 610840db-f57a-52c5-a4ea-0bd1863c29c4 with identifier: KV41270
2026-03-28 11:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 610840db-f57a-52c5-a4ea-0bd1863c29c4 with identifier: KV41270 to the API
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:15:03Z',
 'fuel_type': 'petrol',
 'id': '610840db-f57a-52c5-a4ea-0bd1863c29c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV41270',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Primera',
 'odometer': 147938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-02-28',
 'seller_name': None,
 'title': 'Nissan Primera 1.6 GX',
 'transmission': 'manual',
 'trim': 'GX',
 'year': 1998}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV41270%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Saving data for KV41270: {'auction_closing_time': 1774714503.0, 'created_time': 1774090908.282799, 'last_price_update_time': 1774695850.521736}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KV41270') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 617e54fb-56f1-5502-ae4e-325cb1081588 with identifier: TH31010
2026-03-28 11:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 617e54fb-56f1-5502-ae4e-325cb1081588 with identifier: TH31010
2026-03-28 11:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 617e54fb-56f1-5502-ae4e-325cb1081588 with identifier: TH31010 to the API
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:02:15Z',
 'fuel_type': 'petrol',
 'id': '617e54fb-56f1-5502-ae4e-325cb1081588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH31010',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 98964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-06',
 'seller_name': None,
 'title': 'Citroen C3 1.1 Furio',
 'transmission': 'manual',
 'trim': 'Furio',
 'year': 2007}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH31010%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Saving data for TH31010: {'auction_closing_time': 1774713735.0, 'created_time': 1773669719.925651, 'last_price_update_time': 1774695850.840709}
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH31010') HTTP/1.1" 204 0
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: PD21728
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: XK73032
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK73032%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [auto1.es] INFO: Scrape type for XK73032: 2
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea7f922-17a4-57d1-b1a6-77873602c392 with identifier: XK73032
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea7f922-17a4-57d1-b1a6-77873602c392 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea7f922-17a4-57d1-b1a6-77873602c392 with scrape type 2
2026-03-28 11:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ea7f922-17a4-57d1-b1a6-77873602c392, identifier: XK73032
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: PP39110
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: TT72287
2026-03-28 11:04:10 [auto1.es] INFO: Found listing with ID: KL48857
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL48857%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Scrape type for KL48857: 0
2026-03-28 11:04:11 [auto1.es] INFO: Found listing with ID: RY19109
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY19109%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Scrape type for RY19109: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eef8bde-82e8-5f09-a6eb-3598d285e38c with identifier: RY19109
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eef8bde-82e8-5f09-a6eb-3598d285e38c with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eef8bde-82e8-5f09-a6eb-3598d285e38c with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2eef8bde-82e8-5f09-a6eb-3598d285e38c, identifier: RY19109
2026-03-28 11:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ea7f922-17a4-57d1-b1a6-77873602c392 with identifier: XK73032
2026-03-28 11:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ea7f922-17a4-57d1-b1a6-77873602c392 with identifier: XK73032
2026-03-28 11:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ea7f922-17a4-57d1-b1a6-77873602c392 with identifier: XK73032 to the API
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:26Z',
 'fuel_type': 'diesel',
 'id': '8ea7f922-17a4-57d1-b1a6-77873602c392',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK73032',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 149554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Seat Altea 1.6 TDI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2011}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK73032%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Saving data for XK73032: {'auction_closing_time': 1774715786.0, 'created_time': 1773842612.167099, 'last_price_update_time': 1774695851.405006}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK73032') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2eef8bde-82e8-5f09-a6eb-3598d285e38c with identifier: RY19109
2026-03-28 11:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2eef8bde-82e8-5f09-a6eb-3598d285e38c with identifier: RY19109
2026-03-28 11:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2eef8bde-82e8-5f09-a6eb-3598d285e38c with identifier: RY19109 to the API
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:59Z',
 'fuel_type': 'diesel',
 'id': '2eef8bde-82e8-5f09-a6eb-3598d285e38c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY19109',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 173602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY19109%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Saving data for RY19109: {'auction_closing_time': 1774716359.0, 'created_time': 1774296102.451192, 'last_price_update_time': 1774695851.798236}
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY19109') HTTP/1.1" 204 0
2026-03-28 11:04:11 [auto1.es] INFO: Found listing with ID: TN29066
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN29066%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Scrape type for TN29066: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfde114-2349-59eb-b431-8a27ecea677d with identifier: TN29066
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfde114-2349-59eb-b431-8a27ecea677d with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfde114-2349-59eb-b431-8a27ecea677d with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0cfde114-2349-59eb-b431-8a27ecea677d, identifier: TN29066
2026-03-28 11:04:11 [auto1.es] INFO: Found listing with ID: MK23766
2026-03-28 11:04:11 [auto1.es] INFO: Found listing with ID: DR64033
2026-03-28 11:04:11 [auto1.es] INFO: Found listing with ID: TH38754
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH38754%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [auto1.es] INFO: Scrape type for TH38754: 2
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with identifier: TH38754
2026-03-28 11:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with scrape type 2
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7a1d8b6e-16c3-5f26-9155-a2a7a08365af, identifier: TH38754
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0cfde114-2349-59eb-b431-8a27ecea677d with identifier: TN29066
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0cfde114-2349-59eb-b431-8a27ecea677d with identifier: TN29066
2026-03-28 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0cfde114-2349-59eb-b431-8a27ecea677d with identifier: TN29066 to the API
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:56:27Z',
 'fuel_type': 'diesel',
 'id': '0cfde114-2349-59eb-b431-8a27ecea677d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN29066',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 176317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-24',
 'seller_name': None,
 'title': 'BMW 1er 114d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN29066%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.es] INFO: Saving data for TN29066: {'auction_closing_time': 1774716987.0, 'created_time': 1774609388.272183, 'last_price_update_time': 1774695852.275348}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN29066') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with identifier: TH38754
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with identifier: TH38754
2026-03-28 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7a1d8b6e-16c3-5f26-9155-a2a7a08365af with identifier: TH38754 to the API
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:41Z',
 'fuel_type': 'diesel',
 'id': '7a1d8b6e-16c3-5f26-9155-a2a7a08365af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH38754',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 253899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-29',
 'seller_name': None,
 'title': 'Kia Rio 1.5 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2007}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH38754%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.es] INFO: Saving data for TH38754: {'auction_closing_time': 1774717001.0, 'created_time': 1773127018.670083, 'last_price_update_time': 1774695852.562259}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH38754') HTTP/1.1" 204 0
2026-03-28 11:04:12 [auto1.es] INFO: Found listing with ID: RS45242
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RS45242%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.es] INFO: Scrape type for RS45242: 0
2026-03-28 11:04:12 [auto1.es] INFO: Found listing with ID: RT04886
2026-03-28 11:04:12 [auto1.es] INFO: Found listing with ID: JC38983
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC38983%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.es] INFO: Scrape type for JC38983: 2
2026-03-28 11:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with identifier: JC38983
2026-03-28 11:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f03eacd9-ed0a-5a15-9bf2-e381e779b6ca, identifier: JC38983
2026-03-28 11:04:12 [auto1.es] INFO: Found listing with ID: FU14405
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU14405%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [auto1.es] INFO: Scrape type for FU14405: 2
2026-03-28 11:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1899991-6d38-5e3b-a95d-2c2b538878a3 with identifier: FU14405
2026-03-28 11:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1899991-6d38-5e3b-a95d-2c2b538878a3 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1899991-6d38-5e3b-a95d-2c2b538878a3 with scrape type 2
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1899991-6d38-5e3b-a95d-2c2b538878a3, identifier: FU14405
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with identifier: JC38983
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with identifier: JC38983
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f03eacd9-ed0a-5a15-9bf2-e381e779b6ca with identifier: JC38983 to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:13:27Z',
 'fuel_type': 'diesel',
 'id': 'f03eacd9-ed0a-5a15-9bf2-e381e779b6ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC38983',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 286873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC38983%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.es] INFO: Saving data for JC38983: {'auction_closing_time': 1774714407.0, 'created_time': 1773127785.208118, 'last_price_update_time': 1774695853.230517}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC38983') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1899991-6d38-5e3b-a95d-2c2b538878a3 with identifier: FU14405
2026-03-28 11:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1899991-6d38-5e3b-a95d-2c2b538878a3 with identifier: FU14405
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c1899991-6d38-5e3b-a95d-2c2b538878a3 with identifier: FU14405 to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:29:25Z',
 'fuel_type': 'petrol',
 'id': 'c1899991-6d38-5e3b-a95d-2c2b538878a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU14405',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 43850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU14405%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.es] INFO: Saving data for FU14405: {'auction_closing_time': 1774715365.0, 'created_time': 1773843259.748089, 'last_price_update_time': 1774695853.535759}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FU14405') HTTP/1.1" 204 0
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: KD08887
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD08887%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.es] INFO: Scrape type for KD08887: 0
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: EK86006
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: XL12491
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: VR29926
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.es] INFO: Scrape type for VR29926: 2
2026-03-28 11:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-03-28 11:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b20dd3b1-cc62-5aac-aa7f-e554e0f94195, identifier: VR29926
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: PD86662
2026-03-28 11:04:13 [auto1.es] INFO: Found listing with ID: XC40695
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC40695%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [auto1.es] INFO: Scrape type for XC40695: 2
2026-03-28 11:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0d9f978-8014-59ec-9fc5-63b95e788d6b with identifier: XC40695
2026-03-28 11:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d9f978-8014-59ec-9fc5-63b95e788d6b with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0d9f978-8014-59ec-9fc5-63b95e788d6b with scrape type 2
2026-03-28 11:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0d9f978-8014-59ec-9fc5-63b95e788d6b, identifier: XC40695
2026-03-28 11:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-03-28 11:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926 to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:04:35Z',
 'fuel_type': 'petrol',
 'id': 'b20dd3b1-cc62-5aac-aa7f-e554e0f94195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR29926',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 43174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2022}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.es] INFO: Saving data for VR29926: {'auction_closing_time': 1774713875.0, 'created_time': 1773132565.235767, 'last_price_update_time': 1774695854.073314}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR29926') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0d9f978-8014-59ec-9fc5-63b95e788d6b with identifier: XC40695
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0d9f978-8014-59ec-9fc5-63b95e788d6b with identifier: XC40695
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f0d9f978-8014-59ec-9fc5-63b95e788d6b with identifier: XC40695 to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:08:19Z',
 'fuel_type': 'diesel',
 'id': 'f0d9f978-8014-59ec-9fc5-63b95e788d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC40695',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 103179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'BMW 4er 430d Gran Coupé',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC40695%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.es] INFO: Saving data for XC40695: {'auction_closing_time': 1774714099.0, 'created_time': 1773820833.8132, 'last_price_update_time': 1774695854.456007}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC40695') HTTP/1.1" 204 0
2026-03-28 11:04:14 [auto1.es] INFO: Found listing with ID: YC02097
2026-03-28 11:04:14 [auto1.es] INFO: Found listing with ID: FK65100
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK65100%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.es] INFO: Scrape type for FK65100: 2
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11551479-982f-55a4-a0a2-6fc76353b36d with identifier: FK65100
2026-03-28 11:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11551479-982f-55a4-a0a2-6fc76353b36d with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11551479-982f-55a4-a0a2-6fc76353b36d with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 11551479-982f-55a4-a0a2-6fc76353b36d, identifier: FK65100
2026-03-28 11:04:14 [auto1.es] INFO: Found listing with ID: VE50785
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE50785%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [auto1.es] INFO: Scrape type for VE50785: 2
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-03-28 11:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc3b72b-65a0-5714-81e4-858b5087659a with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fc3b72b-65a0-5714-81e4-858b5087659a with scrape type 2
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4fc3b72b-65a0-5714-81e4-858b5087659a, identifier: VE50785
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 11551479-982f-55a4-a0a2-6fc76353b36d with identifier: FK65100
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 11551479-982f-55a4-a0a2-6fc76353b36d with identifier: FK65100
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 11551479-982f-55a4-a0a2-6fc76353b36d with identifier: FK65100 to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:07:29Z',
 'fuel_type': 'petrol',
 'id': '11551479-982f-55a4-a0a2-6fc76353b36d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK65100',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 127493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK65100%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.es] INFO: Saving data for FK65100: {'auction_closing_time': 1774714049.0, 'created_time': 1774037166.644978, 'last_price_update_time': 1774695855.084113}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK65100') HTTP/1.1" 204 0
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785
2026-03-28 11:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4fc3b72b-65a0-5714-81e4-858b5087659a with identifier: VE50785 to the API
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:46:17Z',
 'fuel_type': 'diesel',
 'id': '4fc3b72b-65a0-5714-81e4-858b5087659a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE50785',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'IS-Serie',
 'odometer': 160087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-27',
 'seller_name': None,
 'title': 'Lexus IS-Serie IS 220d Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE50785%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.es] INFO: Saving data for VE50785: {'auction_closing_time': 1774716377.0, 'created_time': 1773131378.35672, 'last_price_update_time': 1774695855.408892}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE50785') HTTP/1.1" 204 0
2026-03-28 11:04:15 [auto1.es] INFO: Found listing with ID: ZT16054
2026-03-28 11:04:15 [auto1.es] INFO: Found listing with ID: VC62552
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC62552%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.es] INFO: Scrape type for VC62552: 2
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2978e03-c650-56e2-aa49-b4a81770a588 with identifier: VC62552
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2978e03-c650-56e2-aa49-b4a81770a588 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2978e03-c650-56e2-aa49-b4a81770a588 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2978e03-c650-56e2-aa49-b4a81770a588, identifier: VC62552
2026-03-28 11:04:15 [auto1.es] INFO: Found listing with ID: NT66217
2026-03-28 11:04:15 [auto1.es] INFO: Found listing with ID: AP64153
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64153%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.es] INFO: Scrape type for AP64153: 2
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4bc361-0fc9-5c90-ba91-55739842b039 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4bc361-0fc9-5c90-ba91-55739842b039 with scrape type 2
2026-03-28 11:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf4bc361-0fc9-5c90-ba91-55739842b039, identifier: AP64153
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2978e03-c650-56e2-aa49-b4a81770a588 with identifier: VC62552
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2978e03-c650-56e2-aa49-b4a81770a588 with identifier: VC62552
2026-03-28 11:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2978e03-c650-56e2-aa49-b4a81770a588 with identifier: VC62552 to the API
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'diesel',
 'id': 'b2978e03-c650-56e2-aa49-b4a81770a588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC62552',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 310007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-11',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VC62552%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [auto1.es] INFO: Saving data for VC62552: {'auction_closing_time': 1774713795.0, 'created_time': 1772753541.947211, 'last_price_update_time': 1774695855.93683}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VC62552') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf4bc361-0fc9-5c90-ba91-55739842b039 with identifier: AP64153 to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'diesel',
 'id': 'cf4bc361-0fc9-5c90-ba91-55739842b039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP64153',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 67630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-28',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP64153%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.es] INFO: Saving data for AP64153: {'auction_closing_time': 1774714267.0, 'created_time': 1773129217.25029, 'last_price_update_time': 1774695856.238359}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP64153') HTTP/1.1" 204 0
2026-03-28 11:04:16 [auto1.es] INFO: Found listing with ID: DD15597
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD15597%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.es] INFO: Scrape type for DD15597: 2
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73ecdc0-4aab-5fbe-a699-8454913eb2eb with identifier: DD15597
2026-03-28 11:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73ecdc0-4aab-5fbe-a699-8454913eb2eb with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73ecdc0-4aab-5fbe-a699-8454913eb2eb with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b73ecdc0-4aab-5fbe-a699-8454913eb2eb, identifier: DD15597
2026-03-28 11:04:16 [auto1.es] INFO: Found listing with ID: PK37230
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK37230%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.es] INFO: Scrape type for PK37230: 2
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-03-28 11:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with scrape type 2
2026-03-28 11:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd, identifier: PK37230
2026-03-28 11:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b73ecdc0-4aab-5fbe-a699-8454913eb2eb with identifier: DD15597
2026-03-28 11:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b73ecdc0-4aab-5fbe-a699-8454913eb2eb with identifier: DD15597
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b73ecdc0-4aab-5fbe-a699-8454913eb2eb with identifier: DD15597 to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:38:21Z',
 'fuel_type': 'diesel',
 'id': 'b73ecdc0-4aab-5fbe-a699-8454913eb2eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD15597',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 140815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
 'transmission': 'automatic',
 'trim': 'AMG Sport',
 'year': 2018}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD15597%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [auto1.es] INFO: Saving data for DD15597: {'auction_closing_time': 1774715901.0, 'created_time': 1773900673.019196, 'last_price_update_time': 1774695856.776871}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DD15597') HTTP/1.1" 204 0
2026-03-28 11:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-03-28 11:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 950d8884-0044-54db-b4ae-b1b2aa5ef9bd with identifier: PK37230 to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:15:48Z',
 'fuel_type': 'petrol',
 'id': '950d8884-0044-54db-b4ae-b1b2aa5ef9bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK37230',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 143096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-03',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK37230%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.es] INFO: Saving data for PK37230: {'auction_closing_time': 1774714548.0, 'created_time': 1773130633.305986, 'last_price_update_time': 1774695857.08863}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK37230') HTTP/1.1" 204 0
2026-03-28 11:04:17 [auto1.es] INFO: Found listing with ID: LE34718
2026-03-28 11:04:17 [auto1.es] INFO: Found listing with ID: FM31640
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM31640%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.es] INFO: Scrape type for FM31640: 2
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76336f60-ee37-5c9b-be7f-b2ab52778008 with identifier: FM31640
2026-03-28 11:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76336f60-ee37-5c9b-be7f-b2ab52778008 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76336f60-ee37-5c9b-be7f-b2ab52778008 with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76336f60-ee37-5c9b-be7f-b2ab52778008, identifier: FM31640
2026-03-28 11:04:17 [auto1.es] INFO: Channel: 24h | Page: 62 | totalHits: 2554 | hits on page: 40
2026-03-28 11:04:17 [auto1.es] INFO: Found listing with ID: CW49447
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW49447%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.es] INFO: Scrape type for CW49447: 2
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6645ab71-0ed4-58c3-9898-06ad4710adbc with identifier: CW49447
2026-03-28 11:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6645ab71-0ed4-58c3-9898-06ad4710adbc with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6645ab71-0ed4-58c3-9898-06ad4710adbc with scrape type 2
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6645ab71-0ed4-58c3-9898-06ad4710adbc, identifier: CW49447
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76336f60-ee37-5c9b-be7f-b2ab52778008 with identifier: FM31640
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76336f60-ee37-5c9b-be7f-b2ab52778008 with identifier: FM31640
2026-03-28 11:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76336f60-ee37-5c9b-be7f-b2ab52778008 with identifier: FM31640 to the API
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:29:16Z',
 'fuel_type': 'petrol',
 'id': '76336f60-ee37-5c9b-be7f-b2ab52778008',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM31640',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 256043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8 Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2004}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM31640%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [auto1.es] INFO: Saving data for FM31640: {'auction_closing_time': 1774715356.0, 'created_time': 1773130302.503623, 'last_price_update_time': 1774695857.649704}
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FM31640') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6645ab71-0ed4-58c3-9898-06ad4710adbc with identifier: CW49447
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6645ab71-0ed4-58c3-9898-06ad4710adbc with identifier: CW49447
2026-03-28 11:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6645ab71-0ed4-58c3-9898-06ad4710adbc with identifier: CW49447 to the API
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:36:20Z',
 'fuel_type': 'petrol',
 'id': '6645ab71-0ed4-58c3-9898-06ad4710adbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW49447',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 107354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-28',
 'seller_name': None,
 'title': 'Renault Clio 1.4 Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2007}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW49447%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Saving data for CW49447: {'auction_closing_time': 1774715780.0, 'created_time': 1773126766.737483, 'last_price_update_time': 1774695858.026919}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW49447') HTTP/1.1" 204 0
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: XS51461
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: ZD85047
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: MD04984
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: WD34727
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD34727%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Scrape type for WD34727: 2
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with identifier: WD34727
2026-03-28 11:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d750bfc1-2ab1-5309-bdcd-71ad36dd9f35, identifier: WD34727
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: DU61809
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: PH11049
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH11049%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Scrape type for PH11049: 2
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8764c0-90b1-58f2-8049-b7e47641a519 with identifier: PH11049
2026-03-28 11:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8764c0-90b1-58f2-8049-b7e47641a519 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8764c0-90b1-58f2-8049-b7e47641a519 with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e8764c0-90b1-58f2-8049-b7e47641a519, identifier: PH11049
2026-03-28 11:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: BG55573
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: CT91769
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: UV80286
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: RP83421
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: YE20956
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with identifier: WD34727
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with identifier: WD34727
2026-03-28 11:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d750bfc1-2ab1-5309-bdcd-71ad36dd9f35 with identifier: WD34727 to the API
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-28T16:16:53Z',
 'fuel_type': 'petrol',
 'id': 'd750bfc1-2ab1-5309-bdcd-71ad36dd9f35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD34727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 75137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WD34727%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Saving data for WD34727: {'auction_closing_time': 1774714613.0, 'created_time': 1774296300.880347, 'last_price_update_time': 1774695858.508666}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WD34727') HTTP/1.1" 204 0
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e8764c0-90b1-58f2-8049-b7e47641a519 with identifier: PH11049
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e8764c0-90b1-58f2-8049-b7e47641a519 with identifier: PH11049
2026-03-28 11:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e8764c0-90b1-58f2-8049-b7e47641a519 with identifier: PH11049 to the API
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'petrol',
 'id': '8e8764c0-90b1-58f2-8049-b7e47641a519',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH11049',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 74221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH11049%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Saving data for PH11049: {'auction_closing_time': 1774715744.0, 'created_time': 1773691233.390246, 'last_price_update_time': 1774695858.903328}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH11049') HTTP/1.1" 204 0
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: TT49974
2026-03-28 11:04:18 [auto1.es] INFO: Found listing with ID: ZE13912
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE13912%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [auto1.es] INFO: Scrape type for ZE13912: 2
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc97432f-025d-51f4-ba07-68b93bbae60a with identifier: ZE13912
2026-03-28 11:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc97432f-025d-51f4-ba07-68b93bbae60a with scrape type 2
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc97432f-025d-51f4-ba07-68b93bbae60a with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc97432f-025d-51f4-ba07-68b93bbae60a, identifier: ZE13912
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: GX91950
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX91950%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Scrape type for GX91950: 2
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e97f80af-424c-591e-994d-93d4dbe3800e with identifier: GX91950
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97f80af-424c-591e-994d-93d4dbe3800e with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e97f80af-424c-591e-994d-93d4dbe3800e with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e97f80af-424c-591e-994d-93d4dbe3800e, identifier: GX91950
2026-03-28 11:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc97432f-025d-51f4-ba07-68b93bbae60a with identifier: ZE13912
2026-03-28 11:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc97432f-025d-51f4-ba07-68b93bbae60a with identifier: ZE13912
2026-03-28 11:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc97432f-025d-51f4-ba07-68b93bbae60a with identifier: ZE13912 to the API
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:37:48Z',
 'fuel_type': 'diesel',
 'id': 'fc97432f-025d-51f4-ba07-68b93bbae60a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE13912',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 171778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Tecno BlueDrive 2WD',
 'transmission': 'manual',
 'trim': 'Tecno BlueDrive 2WD',
 'year': 2016}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE13912%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Saving data for ZE13912: {'auction_closing_time': 1774715868.0, 'created_time': 1774263657.805288, 'last_price_update_time': 1774695859.424964}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE13912') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e97f80af-424c-591e-994d-93d4dbe3800e with identifier: GX91950
2026-03-28 11:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e97f80af-424c-591e-994d-93d4dbe3800e with identifier: GX91950
2026-03-28 11:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e97f80af-424c-591e-994d-93d4dbe3800e with identifier: GX91950 to the API
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:14:01Z',
 'fuel_type': 'petrol',
 'id': 'e97f80af-424c-591e-994d-93d4dbe3800e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX91950',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 117876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-29',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Hit',
 'transmission': 'manual',
 'trim': 'Hit',
 'year': 2007}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX91950%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Saving data for GX91950: {'auction_closing_time': 1774714441.0, 'created_time': 1774296085.261331, 'last_price_update_time': 1774695859.70354}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GX91950') HTTP/1.1" 204 0
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: AM05329
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: TH42321
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH42321%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Scrape type for TH42321: 2
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with identifier: TH42321
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad, identifier: TH42321
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: YJ04642
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ04642%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Scrape type for YJ04642: 0
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: XZ30156
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: XF66468
2026-03-28 11:04:19 [auto1.es] INFO: Found listing with ID: FX14772
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX14772%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [auto1.es] INFO: Scrape type for FX14772: 2
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e33d0c71-b0b6-506d-ae87-2d42667414b1 with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e33d0c71-b0b6-506d-ae87-2d42667414b1 with scrape type 2
2026-03-28 11:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e33d0c71-b0b6-506d-ae87-2d42667414b1, identifier: FX14772
2026-03-28 11:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with identifier: TH42321
2026-03-28 11:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with identifier: TH42321
2026-03-28 11:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad with identifier: TH42321 to the API
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:24Z',
 'fuel_type': 'diesel',
 'id': '4f32053c-c1b1-56f9-9a7b-67b4d1ff03ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH42321',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 185686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Trendline 4Motion BlueMotion',
 'year': 2018}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH42321%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.es] INFO: Saving data for TH42321: {'auction_closing_time': 1774716804.0, 'created_time': 1773133874.763514, 'last_price_update_time': 1774695860.225376}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH42321') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-03-28 11:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772
2026-03-28 11:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e33d0c71-b0b6-506d-ae87-2d42667414b1 with identifier: FX14772 to the API
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:07:13Z',
 'fuel_type': 'diesel',
 'id': 'e33d0c71-b0b6-506d-ae87-2d42667414b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX14772',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 125678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H1',
 'transmission': 'manual',
 'trim': '33 L2H1',
 'year': 2020}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX14772%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.es] INFO: Saving data for FX14772: {'auction_closing_time': 1774714033.0, 'created_time': 1773127200.79513, 'last_price_update_time': 1774695860.509116}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX14772') HTTP/1.1" 204 0
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: JG85850
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: MU04629
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: MW15131
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: UM71516
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM71516%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.es] INFO: Scrape type for UM71516: 2
2026-03-28 11:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with identifier: UM71516
2026-03-28 11:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a, identifier: UM71516
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: VN13138
2026-03-28 11:04:20 [auto1.es] INFO: Found listing with ID: EN73965
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN73965%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [auto1.es] INFO: Scrape type for EN73965: 2
2026-03-28 11:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-03-28 11:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with scrape type 2
2026-03-28 11:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 902ca510-e4bd-5813-b13a-8a9dc35c39b4, identifier: EN73965
2026-03-28 11:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with identifier: UM71516
2026-03-28 11:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with identifier: UM71516
2026-03-28 11:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 070d59fe-bf5a-57a4-96e8-3a0c637f7d4a with identifier: UM71516 to the API
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:27:00Z',
 'fuel_type': 'diesel',
 'id': '070d59fe-bf5a-57a4-96e8-3a0c637f7d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM71516',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 221364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-27',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2012}
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM71516%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Saving data for UM71516: {'auction_closing_time': 1774715220.0, 'created_time': 1770918800.925492, 'last_price_update_time': 1774695861.004614}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UM71516') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-03-28 11:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965
2026-03-28 11:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 902ca510-e4bd-5813-b13a-8a9dc35c39b4 with identifier: EN73965 to the API
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:22Z',
 'fuel_type': 'diesel',
 'id': '902ca510-e4bd-5813-b13a-8a9dc35c39b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN73965',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 88128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN73965%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Saving data for EN73965: {'auction_closing_time': 1774715482.0, 'created_time': 1772623230.831724, 'last_price_update_time': 1774695861.474167}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN73965') HTTP/1.1" 204 0
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: VT35195
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: PD96380
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD96380%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Scrape type for PD96380: 0
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: UD80298
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: PH10774
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: AL10193
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: RR40846
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: LR89235
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: YA86748
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: ND59157
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND59157%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Scrape type for ND59157: 2
2026-03-28 11:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6042617-d6a6-58ed-870d-7e148088451d with identifier: ND59157
2026-03-28 11:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6042617-d6a6-58ed-870d-7e148088451d with scrape type 2
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6042617-d6a6-58ed-870d-7e148088451d with scrape type 2
2026-03-28 11:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6042617-d6a6-58ed-870d-7e148088451d, identifier: ND59157
2026-03-28 11:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6042617-d6a6-58ed-870d-7e148088451d with identifier: ND59157
2026-03-28 11:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6042617-d6a6-58ed-870d-7e148088451d with identifier: ND59157
2026-03-28 11:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6042617-d6a6-58ed-870d-7e148088451d with identifier: ND59157 to the API
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:00Z',
 'fuel_type': 'diesel',
 'id': 'd6042617-d6a6-58ed-870d-7e148088451d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND59157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 219863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-05',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND59157%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Saving data for ND59157: {'auction_closing_time': 1774714380.0, 'created_time': 1773128702.275353, 'last_price_update_time': 1774695861.886413}
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ND59157') HTTP/1.1" 204 0
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: KZ49779
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KZ49779%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Scrape type for KZ49779: 0
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: YT85498
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: VZ06267
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: GC26553
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: YU03196
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: PA92548
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: JJ75829
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: SV29323
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SV29323%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Scrape type for SV29323: 0
2026-03-28 11:04:21 [auto1.es] INFO: Found listing with ID: TB73704
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB73704%27 HTTP/1.1" 200 None
2026-03-28 11:04:21 [auto1.es] INFO: Scrape type for TB73704: 2
2026-03-28 11:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e3f3768-72e3-5c81-808c-623183f8e4f4 with identifier: TB73704
2026-03-28 11:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e3f3768-72e3-5c81-808c-623183f8e4f4 with scrape type 2
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e3f3768-72e3-5c81-808c-623183f8e4f4 with scrape type 2
2026-03-28 11:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7e3f3768-72e3-5c81-808c-623183f8e4f4, identifier: TB73704
2026-03-28 11:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7e3f3768-72e3-5c81-808c-623183f8e4f4 with identifier: TB73704
2026-03-28 11:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7e3f3768-72e3-5c81-808c-623183f8e4f4 with identifier: TB73704
2026-03-28 11:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7e3f3768-72e3-5c81-808c-623183f8e4f4 with identifier: TB73704 to the API
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:01:57Z',
 'fuel_type': 'petrol',
 'id': '7e3f3768-72e3-5c81-808c-623183f8e4f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB73704',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 141204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-08',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB73704%27 HTTP/1.1" 200 None
2026-03-28 11:04:22 [auto1.es] INFO: Saving data for TB73704: {'auction_closing_time': 1774713717.0, 'created_time': 1774296151.443107, 'last_price_update_time': 1774695862.309633}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB73704') HTTP/1.1" 204 0
2026-03-28 11:04:22 [auto1.es] INFO: Found listing with ID: VD81677
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD81677%27 HTTP/1.1" 200 None
2026-03-28 11:04:22 [auto1.es] INFO: Scrape type for VD81677: 2
2026-03-28 11:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with identifier: VD81677
2026-03-28 11:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with scrape type 2
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with scrape type 2
2026-03-28 11:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b770d9e-ff7a-52c4-ae0f-5001603388c8, identifier: VD81677
2026-03-28 11:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with identifier: VD81677
2026-03-28 11:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with identifier: VD81677
2026-03-28 11:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b770d9e-ff7a-52c4-ae0f-5001603388c8 with identifier: VD81677 to the API
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-28T16:59:25Z',
 'fuel_type': 'hybrid',
 'id': '1b770d9e-ff7a-52c4-ae0f-5001603388c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD81677',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 210493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Tecno',
 'transmission': 'automatic',
 'trim': 'Tecno',
 'year': 2020}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD81677%27 HTTP/1.1" 200 None
2026-03-28 11:04:22 [auto1.es] INFO: Saving data for VD81677: {'auction_closing_time': 1774717165.0, 'created_time': 1772623104.247779, 'last_price_update_time': 1774695862.827967}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VD81677') HTTP/1.1" 204 0
2026-03-28 11:04:22 [auto1.es] INFO: Found listing with ID: EJ16249
2026-03-28 11:04:22 [auto1.es] INFO: Found listing with ID: UH45112
2026-03-28 11:04:22 [auto1.es] INFO: Found listing with ID: DZ42678
2026-03-28 11:04:22 [auto1.es] INFO: Found listing with ID: VR45740
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR45740%27 HTTP/1.1" 200 None
2026-03-28 11:04:22 [auto1.es] INFO: Scrape type for VR45740: 2
2026-03-28 11:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with identifier: VR45740
2026-03-28 11:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with scrape type 2
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with scrape type 2
2026-03-28 11:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 230932bf-787f-5805-99e0-6f1d5bb9f0c6, identifier: VR45740
2026-03-28 11:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with identifier: VR45740
2026-03-28 11:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with identifier: VR45740
2026-03-28 11:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 230932bf-787f-5805-99e0-6f1d5bb9f0c6 with identifier: VR45740 to the API
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:57:51Z',
 'fuel_type': 'petrol',
 'id': '230932bf-787f-5805-99e0-6f1d5bb9f0c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR45740',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 12962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2020}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR45740%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [auto1.es] INFO: Saving data for VR45740: {'auction_closing_time': 1774717071.0, 'created_time': 1773669827.088309, 'last_price_update_time': 1774695863.259387}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR45740') HTTP/1.1" 204 0
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: FK61059
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: VC98401
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: PS29729
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: WZ34012
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ34012%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [auto1.es] INFO: Scrape type for WZ34012: 2
2026-03-28 11:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33181af3-75d1-5c31-b494-fc29c67d021e with identifier: WZ34012
2026-03-28 11:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33181af3-75d1-5c31-b494-fc29c67d021e with scrape type 2
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33181af3-75d1-5c31-b494-fc29c67d021e with scrape type 2
2026-03-28 11:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 33181af3-75d1-5c31-b494-fc29c67d021e, identifier: WZ34012
2026-03-28 11:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 33181af3-75d1-5c31-b494-fc29c67d021e with identifier: WZ34012
2026-03-28 11:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 33181af3-75d1-5c31-b494-fc29c67d021e with identifier: WZ34012
2026-03-28 11:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 33181af3-75d1-5c31-b494-fc29c67d021e with identifier: WZ34012 to the API
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:54Z',
 'fuel_type': 'diesel',
 'id': '33181af3-75d1-5c31-b494-fc29c67d021e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ34012',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 289594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-04',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WZ34012%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [auto1.es] INFO: Saving data for WZ34012: {'auction_closing_time': 1774713894.0, 'created_time': 1772752960.182361, 'last_price_update_time': 1774695863.905535}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ34012') HTTP/1.1" 204 0
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: ZP51440
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: ZS20717
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS20717%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [auto1.es] INFO: Scrape type for ZS20717: 0
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: NY16020
2026-03-28 11:04:23 [auto1.es] INFO: Found listing with ID: GT44883
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT44883%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [auto1.es] INFO: Scrape type for GT44883: 2
2026-03-28 11:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-03-28 11:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with scrape type 2
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3, identifier: GT44883
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883
2026-03-28 11:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b344bbe-c22f-549c-a5cd-5e0e723c38f3 with identifier: GT44883 to the API
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:29Z',
 'fuel_type': 'diesel',
 'id': '6b344bbe-c22f-549c-a5cd-5e0e723c38f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT44883',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 253454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT44883%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.es] INFO: Saving data for GT44883: {'auction_closing_time': 1774715129.0, 'created_time': 1773864037.887873, 'last_price_update_time': 1774695864.327856}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GT44883') HTTP/1.1" 204 0
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: XV33818
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV33818%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.es] INFO: Scrape type for XV33818: 0
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: KX99272
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: AD67761
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD67761%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.es] INFO: Scrape type for AD67761: 2
2026-03-28 11:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e04070d-71ab-5cec-99ad-50cefd5d591f with identifier: AD67761
2026-03-28 11:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e04070d-71ab-5cec-99ad-50cefd5d591f with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e04070d-71ab-5cec-99ad-50cefd5d591f with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4e04070d-71ab-5cec-99ad-50cefd5d591f, identifier: AD67761
2026-03-28 11:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4e04070d-71ab-5cec-99ad-50cefd5d591f with identifier: AD67761
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4e04070d-71ab-5cec-99ad-50cefd5d591f with identifier: AD67761
2026-03-28 11:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4e04070d-71ab-5cec-99ad-50cefd5d591f with identifier: AD67761 to the API
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:03:12Z',
 'fuel_type': 'diesel',
 'id': '4e04070d-71ab-5cec-99ad-50cefd5d591f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD67761',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 210632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AD67761%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.es] INFO: Saving data for AD67761: {'auction_closing_time': 1774713792.0, 'created_time': 1774296356.058427, 'last_price_update_time': 1774695864.855752}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AD67761') HTTP/1.1" 204 0
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: ZE85496
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: RT81282
2026-03-28 11:04:24 [auto1.es] INFO: Found listing with ID: XC28006
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC28006%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.es] INFO: Scrape type for XC28006: 2
2026-03-28 11:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d5c3ae-9822-58eb-bf25-e558a0562142 with identifier: XC28006
2026-03-28 11:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d5c3ae-9822-58eb-bf25-e558a0562142 with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d5c3ae-9822-58eb-bf25-e558a0562142 with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68d5c3ae-9822-58eb-bf25-e558a0562142, identifier: XC28006
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68d5c3ae-9822-58eb-bf25-e558a0562142 with identifier: XC28006
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68d5c3ae-9822-58eb-bf25-e558a0562142 with identifier: XC28006
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 68d5c3ae-9822-58eb-bf25-e558a0562142 with identifier: XC28006 to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:44:37Z',
 'fuel_type': 'petrol',
 'id': '68d5c3ae-9822-58eb-bf25-e558a0562142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC28006',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 94839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC28006%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.es] INFO: Saving data for XC28006: {'auction_closing_time': 1774716277.0, 'created_time': 1774274472.864656, 'last_price_update_time': 1774695865.282097}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC28006') HTTP/1.1" 204 0
2026-03-28 11:04:25 [auto1.es] INFO: Found listing with ID: JP11260
2026-03-28 11:04:25 [auto1.es] INFO: Channel: 24h | Page: 63 | totalHits: 2554 | hits on page: 40
2026-03-28 11:04:25 [auto1.es] INFO: Found listing with ID: MW05620
2026-03-28 11:04:25 [auto1.es] INFO: Found listing with ID: GY32674
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY32674%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.es] INFO: Scrape type for GY32674: 2
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with identifier: GY32674
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 99ec30c8-cfe7-5d43-856b-ae08b7b242aa, identifier: GY32674
2026-03-28 11:04:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with identifier: GY32674
2026-03-28 11:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with identifier: GY32674
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 99ec30c8-cfe7-5d43-856b-ae08b7b242aa with identifier: GY32674 to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:45Z',
 'fuel_type': 'diesel',
 'id': '99ec30c8-cfe7-5d43-856b-ae08b7b242aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY32674',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 176197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2017}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY32674%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.es] INFO: Saving data for GY32674: {'auction_closing_time': 1774715445.0, 'created_time': 1773132260.155568, 'last_price_update_time': 1774695865.741658}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY32674') HTTP/1.1" 204 0
2026-03-28 11:04:25 [auto1.es] INFO: Found listing with ID: TV15408
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV15408%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.es] INFO: Scrape type for TV15408: 2
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9, identifier: TV15408
2026-03-28 11:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-03-28 11:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9 with identifier: TV15408 to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:20Z',
 'fuel_type': 'diesel',
 'id': 'a9de1a59-7ffb-5e83-a2b3-954b6d2cd5a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV15408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 108419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI R-Line BlueMotion',
 'transmission': 'automatic',
 'trim': 'R-Line BlueMotion',
 'year': 2017}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV15408%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Saving data for TV15408: {'auction_closing_time': 1774715660.0, 'created_time': 1774296313.640313, 'last_price_update_time': 1774695866.156528}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV15408') HTTP/1.1" 204 0
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: HV86151
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV86151%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Scrape type for HV86151: 0
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: UZ86093
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: ZM69944
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: RT56400
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT56400%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Scrape type for RT56400: 2
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcc8b895-5d61-5f3c-a071-93ff7de79194 with identifier: RT56400
2026-03-28 11:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcc8b895-5d61-5f3c-a071-93ff7de79194 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcc8b895-5d61-5f3c-a071-93ff7de79194 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bcc8b895-5d61-5f3c-a071-93ff7de79194, identifier: RT56400
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bcc8b895-5d61-5f3c-a071-93ff7de79194 with identifier: RT56400
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bcc8b895-5d61-5f3c-a071-93ff7de79194 with identifier: RT56400
2026-03-28 11:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bcc8b895-5d61-5f3c-a071-93ff7de79194 with identifier: RT56400 to the API
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:31:34Z',
 'fuel_type': 'petrol',
 'id': 'bcc8b895-5d61-5f3c-a071-93ff7de79194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT56400',
 'listing': 'auction',
 'make': 'Daewoo',
 'model': 'Leganza',
 'odometer': 57716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-31',
 'seller_name': None,
 'title': 'Daewoo Leganza 2.0 CDX',
 'transmission': 'manual',
 'trim': 'CDX',
 'year': 2003}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT56400%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Saving data for RT56400: {'auction_closing_time': 1774715494.0, 'created_time': 1773486060.61572, 'last_price_update_time': 1774695866.591448}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT56400') HTTP/1.1" 204 0
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: MZ66022
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ66022%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Scrape type for MZ66022: 0
2026-03-28 11:04:26 [auto1.es] INFO: Found listing with ID: WN54679
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN54679%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.es] INFO: Scrape type for WN54679: 2
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d779276d-2294-5963-8a29-27f290325809 with identifier: WN54679
2026-03-28 11:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d779276d-2294-5963-8a29-27f290325809 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d779276d-2294-5963-8a29-27f290325809 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d779276d-2294-5963-8a29-27f290325809, identifier: WN54679
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d779276d-2294-5963-8a29-27f290325809 with identifier: WN54679
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d779276d-2294-5963-8a29-27f290325809 with identifier: WN54679
2026-03-28 11:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d779276d-2294-5963-8a29-27f290325809 with identifier: WN54679 to the API
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:10:26Z',
 'fuel_type': 'diesel',
 'id': 'd779276d-2294-5963-8a29-27f290325809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN54679',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 159918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-27',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WN54679%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Saving data for WN54679: {'auction_closing_time': 1774714226.0, 'created_time': 1773832407.559413, 'last_price_update_time': 1774695867.107562}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WN54679') HTTP/1.1" 204 0
2026-03-28 11:04:27 [auto1.es] INFO: Found listing with ID: VP18393
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP18393%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Scrape type for VP18393: 2
2026-03-28 11:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with identifier: VP18393
2026-03-28 11:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2, identifier: VP18393
2026-03-28 11:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with identifier: VP18393
2026-03-28 11:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with identifier: VP18393
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2 with identifier: VP18393 to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:12:02Z',
 'fuel_type': 'petrol',
 'id': 'dbbe4cc2-9e7d-5981-ba9d-9478bf1107b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP18393',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 128795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 e-THP 20 Aniversario Edition',
 'transmission': 'manual',
 'trim': '20 Aniversario Edition',
 'year': 2017}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP18393%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Saving data for VP18393: {'auction_closing_time': 1774714322.0, 'created_time': 1773345656.967131, 'last_price_update_time': 1774695867.527823}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VP18393') HTTP/1.1" 204 0
2026-03-28 11:04:27 [auto1.es] INFO: Found listing with ID: DB92602
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB92602%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Scrape type for DB92602: 0
2026-03-28 11:04:27 [auto1.es] INFO: Found listing with ID: WX13119
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX13119%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Scrape type for WX13119: 2
2026-03-28 11:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01526f02-149b-5e03-b6b7-8930e32575fa with identifier: WX13119
2026-03-28 11:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01526f02-149b-5e03-b6b7-8930e32575fa with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01526f02-149b-5e03-b6b7-8930e32575fa with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01526f02-149b-5e03-b6b7-8930e32575fa, identifier: WX13119
2026-03-28 11:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01526f02-149b-5e03-b6b7-8930e32575fa with identifier: WX13119
2026-03-28 11:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01526f02-149b-5e03-b6b7-8930e32575fa with identifier: WX13119
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01526f02-149b-5e03-b6b7-8930e32575fa with identifier: WX13119 to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 86,
 'expiration_date': '2026-03-28T16:05:41Z',
 'fuel_type': 'petrol',
 'id': '01526f02-149b-5e03-b6b7-8930e32575fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX13119',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 87695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 MPI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2011}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX13119%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.es] INFO: Saving data for WX13119: {'auction_closing_time': 1774713941.0, 'created_time': 1773129484.657871, 'last_price_update_time': 1774695867.948117}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WX13119') HTTP/1.1" 204 0
2026-03-28 11:04:27 [auto1.es] INFO: Found listing with ID: UD21856
2026-03-28 11:04:27 [auto1.es] INFO: Found listing with ID: FZ04394
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ04394%27 HTTP/1.1" 200 None
2026-03-28 11:04:28 [auto1.es] INFO: Scrape type for FZ04394: 2
2026-03-28 11:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac652bc0-dabe-53df-9023-aa312720ff6b with identifier: FZ04394
2026-03-28 11:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac652bc0-dabe-53df-9023-aa312720ff6b with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac652bc0-dabe-53df-9023-aa312720ff6b with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ac652bc0-dabe-53df-9023-aa312720ff6b, identifier: FZ04394
2026-03-28 11:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ac652bc0-dabe-53df-9023-aa312720ff6b with identifier: FZ04394
2026-03-28 11:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ac652bc0-dabe-53df-9023-aa312720ff6b with identifier: FZ04394
2026-03-28 11:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ac652bc0-dabe-53df-9023-aa312720ff6b with identifier: FZ04394 to the API
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:09:50Z',
 'fuel_type': 'diesel',
 'id': 'ac652bc0-dabe-53df-9023-aa312720ff6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ04394',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 132759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI GT Sport',
 'transmission': 'manual',
 'trim': 'GT Sport',
 'year': 2008}
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ04394%27 HTTP/1.1" 200 None
2026-03-28 11:04:28 [auto1.es] INFO: Saving data for FZ04394: {'auction_closing_time': 1774714190.0, 'created_time': 1774274508.159666, 'last_price_update_time': 1774695868.857055}
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FZ04394') HTTP/1.1" 204 0
2026-03-28 11:04:28 [auto1.es] INFO: Found listing with ID: XK60422
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK60422%27 HTTP/1.1" 200 None
2026-03-28 11:04:28 [auto1.es] INFO: Scrape type for XK60422: 2
2026-03-28 11:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b435286-6e47-5d9a-b1fb-7a00b7067030 with identifier: XK60422
2026-03-28 11:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b435286-6e47-5d9a-b1fb-7a00b7067030 with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b435286-6e47-5d9a-b1fb-7a00b7067030 with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b435286-6e47-5d9a-b1fb-7a00b7067030, identifier: XK60422
2026-03-28 11:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b435286-6e47-5d9a-b1fb-7a00b7067030 with identifier: XK60422
2026-03-28 11:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b435286-6e47-5d9a-b1fb-7a00b7067030 with identifier: XK60422
2026-03-28 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b435286-6e47-5d9a-b1fb-7a00b7067030 with identifier: XK60422 to the API
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:29Z',
 'fuel_type': 'diesel',
 'id': '4b435286-6e47-5d9a-b1fb-7a00b7067030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK60422',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 314050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2006}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XK60422%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.es] INFO: Saving data for XK60422: {'auction_closing_time': 1774716029.0, 'created_time': 1774101692.874714, 'last_price_update_time': 1774695869.253509}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XK60422') HTTP/1.1" 204 0
2026-03-28 11:04:29 [auto1.es] INFO: Found listing with ID: UF95473
2026-03-28 11:04:29 [auto1.es] INFO: Found listing with ID: ZW56409
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW56409%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.es] INFO: Scrape type for ZW56409: 2
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5afb653-6e4d-53bb-8932-08819ddadb72 with identifier: ZW56409
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5afb653-6e4d-53bb-8932-08819ddadb72 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5afb653-6e4d-53bb-8932-08819ddadb72 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d5afb653-6e4d-53bb-8932-08819ddadb72, identifier: ZW56409
2026-03-28 11:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d5afb653-6e4d-53bb-8932-08819ddadb72 with identifier: ZW56409
2026-03-28 11:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d5afb653-6e4d-53bb-8932-08819ddadb72 with identifier: ZW56409
2026-03-28 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d5afb653-6e4d-53bb-8932-08819ddadb72 with identifier: ZW56409 to the API
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:04:51Z',
 'fuel_type': 'petrol',
 'id': 'd5afb653-6e4d-53bb-8932-08819ddadb72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW56409',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Accent',
 'odometer': 147216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-28',
 'seller_name': None,
 'title': 'Hyundai Accent 1.3 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2005}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW56409%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.es] INFO: Saving data for ZW56409: {'auction_closing_time': 1774713891.0, 'created_time': 1774609392.669275, 'last_price_update_time': 1774695869.625008}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZW56409') HTTP/1.1" 204 0
2026-03-28 11:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:29 [auto1.es] INFO: Found listing with ID: BR13060
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR13060%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.es] INFO: Scrape type for BR13060: 2
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with identifier: BR13060
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81, identifier: BR13060
2026-03-28 11:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with identifier: BR13060
2026-03-28 11:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with identifier: BR13060
2026-03-28 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6c9b15fb-892c-50e4-8ab8-46e1b42d3d81 with identifier: BR13060 to the API
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:09Z',
 'fuel_type': 'diesel',
 'id': '6c9b15fb-892c-50e4-8ab8-46e1b42d3d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR13060',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 194169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR13060%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Saving data for BR13060: {'auction_closing_time': 1774714149.0, 'created_time': 1773128408.966669, 'last_price_update_time': 1774695870.030077}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR13060') HTTP/1.1" 204 0
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: FK50437
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50437%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Scrape type for FK50437: 2
2026-03-28 11:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e60a8f36-5927-5968-969c-2c5771f13dee with identifier: FK50437
2026-03-28 11:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60a8f36-5927-5968-969c-2c5771f13dee with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e60a8f36-5927-5968-969c-2c5771f13dee with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e60a8f36-5927-5968-969c-2c5771f13dee, identifier: FK50437
2026-03-28 11:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e60a8f36-5927-5968-969c-2c5771f13dee with identifier: FK50437
2026-03-28 11:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e60a8f36-5927-5968-969c-2c5771f13dee with identifier: FK50437
2026-03-28 11:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e60a8f36-5927-5968-969c-2c5771f13dee with identifier: FK50437 to the API
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:23:16Z',
 'fuel_type': 'petrol',
 'id': 'e60a8f36-5927-5968-969c-2c5771f13dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK50437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 174917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 207 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2012}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK50437%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Saving data for FK50437: {'auction_closing_time': 1774714996.0, 'created_time': 1773934229.323596, 'last_price_update_time': 1774695870.502832}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK50437') HTTP/1.1" 204 0
2026-03-28 11:04:30 [auto1.es] INFO: Channel: 24h | Page: 64 | totalHits: 2554 | hits on page: 34
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: RD21311
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: XJ78592
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ78592%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Scrape type for XJ78592: 2
2026-03-28 11:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with identifier: XJ78592
2026-03-28 11:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f4b66fc-cbd3-55be-93fc-86019bc15a52, identifier: XJ78592
2026-03-28 11:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with identifier: XJ78592
2026-03-28 11:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with identifier: XJ78592
2026-03-28 11:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f4b66fc-cbd3-55be-93fc-86019bc15a52 with identifier: XJ78592 to the API
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:40Z',
 'fuel_type': 'diesel',
 'id': '2f4b66fc-cbd3-55be-93fc-86019bc15a52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ78592',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 192929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Double Cab GX 4x4',
 'transmission': 'manual',
 'trim': 'Double Cab GX 4x4',
 'year': 2021}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ78592%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Saving data for XJ78592: {'auction_closing_time': 1774715020.0, 'created_time': 1774609389.081733, 'last_price_update_time': 1774695870.889888}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ78592') HTTP/1.1" 204 0
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: CL32416
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL32416%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Scrape type for CL32416: 0
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: YF90515
2026-03-28 11:04:30 [auto1.es] INFO: Found listing with ID: TL16652
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL16652%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.es] INFO: Scrape type for TL16652: 2
2026-03-28 11:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 448ad238-82a5-5be5-a42e-0a7bd6d234df with identifier: TL16652
2026-03-28 11:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448ad238-82a5-5be5-a42e-0a7bd6d234df with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 448ad238-82a5-5be5-a42e-0a7bd6d234df with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 448ad238-82a5-5be5-a42e-0a7bd6d234df, identifier: TL16652
2026-03-28 11:04:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:31 [auto1.es] INFO: Found listing with ID: FU29422
2026-03-28 11:04:31 [auto1.es] INFO: Found listing with ID: NG83144
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG83144%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.es] INFO: Scrape type for NG83144: 2
2026-03-28 11:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f055193-ba81-5d64-9f15-1397059de90f with identifier: NG83144
2026-03-28 11:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f055193-ba81-5d64-9f15-1397059de90f with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f055193-ba81-5d64-9f15-1397059de90f with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1f055193-ba81-5d64-9f15-1397059de90f, identifier: NG83144
2026-03-28 11:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 448ad238-82a5-5be5-a42e-0a7bd6d234df with identifier: TL16652
2026-03-28 11:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 448ad238-82a5-5be5-a42e-0a7bd6d234df with identifier: TL16652
2026-03-28 11:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 448ad238-82a5-5be5-a42e-0a7bd6d234df with identifier: TL16652 to the API
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:32:14Z',
 'fuel_type': 'diesel',
 'id': '448ad238-82a5-5be5-a42e-0a7bd6d234df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL16652',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 194942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL16652%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.es] INFO: Saving data for TL16652: {'auction_closing_time': 1774715534.0, 'created_time': 1774609396.336296, 'last_price_update_time': 1774695871.706852}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TL16652') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1f055193-ba81-5d64-9f15-1397059de90f with identifier: NG83144
2026-03-28 11:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1f055193-ba81-5d64-9f15-1397059de90f with identifier: NG83144
2026-03-28 11:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1f055193-ba81-5d64-9f15-1397059de90f with identifier: NG83144 to the API
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:17Z',
 'fuel_type': 'diesel',
 'id': '1f055193-ba81-5d64-9f15-1397059de90f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG83144',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 136009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Double Cab GX 4x4',
 'transmission': 'manual',
 'trim': 'Double Cab GX 4x4',
 'year': 2020}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG83144%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Saving data for NG83144: {'auction_closing_time': 1774714937.0, 'created_time': 1774609390.074031, 'last_price_update_time': 1774695872.027675}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG83144') HTTP/1.1" 204 0
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: ET37328
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: VB46301
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: SU85789
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: JW67554
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW67554%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Scrape type for JW67554: 2
2026-03-28 11:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f628187-a7b9-5c4a-baec-1efa22101a73 with identifier: JW67554
2026-03-28 11:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f628187-a7b9-5c4a-baec-1efa22101a73 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f628187-a7b9-5c4a-baec-1efa22101a73 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f628187-a7b9-5c4a-baec-1efa22101a73, identifier: JW67554
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: KH84544
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: LM59241
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: TF39547
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF39547%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Scrape type for TF39547: 2
2026-03-28 11:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with identifier: TF39547
2026-03-28 11:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00, identifier: TF39547
2026-03-28 11:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f628187-a7b9-5c4a-baec-1efa22101a73 with identifier: JW67554
2026-03-28 11:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f628187-a7b9-5c4a-baec-1efa22101a73 with identifier: JW67554
2026-03-28 11:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f628187-a7b9-5c4a-baec-1efa22101a73 with identifier: JW67554 to the API
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'diesel',
 'id': '6f628187-a7b9-5c4a-baec-1efa22101a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW67554',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 170576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'BMW X3 xDrive 25d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW67554%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Saving data for JW67554: {'auction_closing_time': 1774715975.0, 'created_time': 1774609394.139529, 'last_price_update_time': 1774695872.546941}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW67554') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with identifier: TF39547
2026-03-28 11:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with identifier: TF39547
2026-03-28 11:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65e8c3da-2e6a-58d8-9e4b-caa31b54ef00 with identifier: TF39547 to the API
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:18Z',
 'fuel_type': 'diesel',
 'id': '65e8c3da-2e6a-58d8-9e4b-caa31b54ef00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF39547',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 123998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Double Cab Le Cap 4WD',
 'transmission': 'automatic',
 'trim': 'Double Cab Le Cap 4WD',
 'year': 2019}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF39547%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Saving data for TF39547: {'auction_closing_time': 1774714758.0, 'created_time': 1774609390.429819, 'last_price_update_time': 1774695872.931595}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF39547') HTTP/1.1" 204 0
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: CY04008
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: NV45891
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: NS96167
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: XV58633
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: UV89988
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: SB36142
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: UU20141
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: DH00541
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH00541%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Scrape type for DH00541: 0
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: ND20390
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND20390%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.es] INFO: Scrape type for ND20390: 0
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: CA13811
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: VM06943
2026-03-28 11:04:32 [auto1.es] INFO: Found listing with ID: GF91510
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF91510%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for GF91510: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: GE94512
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: NM44751
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: HD74513
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: GT92698
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: VN26021
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VN26021%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for VN26021: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: WH54771
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: NL75511
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: LX82632
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX82632%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for LX82632: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: WW97634
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: JM72010
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JM72010%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for JM72010: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: SD86160
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: HF43561
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: PP85710
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: PL21143
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL21143%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for PL21143: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: ZL14108
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL14108%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for ZL14108: 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: UT93063
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT93063%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for UT93063: 2
2026-03-28 11:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with identifier: UT93063
2026-03-28 11:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with scrape type 2
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with scrape type 2
2026-03-28 11:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb312e6a-e7ca-56b8-bac0-d37dcf89c04f, identifier: UT93063
2026-03-28 11:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with identifier: UT93063
2026-03-28 11:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with identifier: UT93063
2026-03-28 11:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb312e6a-e7ca-56b8-bac0-d37dcf89c04f with identifier: UT93063 to the API
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'diesel',
 'id': 'fb312e6a-e7ca-56b8-bac0-d37dcf89c04f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT93063',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 72889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XL',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 XL',
 'year': 2018}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT93063%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Saving data for UT93063: {'auction_closing_time': 1774715840.0, 'created_time': 1774609393.384797, 'last_price_update_time': 1774695873.488514}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT93063') HTTP/1.1" 204 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: WA94101
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: VJ59554
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: MJ93698
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ93698%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for MJ93698: 2
2026-03-28 11:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3575b5-7f97-5659-bcc3-2d170aa9472e with identifier: MJ93698
2026-03-28 11:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3575b5-7f97-5659-bcc3-2d170aa9472e with scrape type 2
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b3575b5-7f97-5659-bcc3-2d170aa9472e with scrape type 2
2026-03-28 11:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b3575b5-7f97-5659-bcc3-2d170aa9472e, identifier: MJ93698
2026-03-28 11:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b3575b5-7f97-5659-bcc3-2d170aa9472e with identifier: MJ93698
2026-03-28 11:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b3575b5-7f97-5659-bcc3-2d170aa9472e with identifier: MJ93698
2026-03-28 11:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b3575b5-7f97-5659-bcc3-2d170aa9472e with identifier: MJ93698 to the API
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:44:30Z',
 'fuel_type': 'diesel',
 'id': '4b3575b5-7f97-5659-bcc3-2d170aa9472e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ93698',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 185663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-25',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L2 Trend',
 'transmission': 'manual',
 'trim': '350 L2 Trend',
 'year': 2018}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ93698%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Saving data for MJ93698: {'auction_closing_time': 1774716270.0, 'created_time': 1774609391.66283, 'last_price_update_time': 1774695873.942705}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ93698') HTTP/1.1" 204 0
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: RA85318
2026-03-28 11:04:33 [auto1.es] INFO: Found listing with ID: RC37181
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC37181%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.es] INFO: Scrape type for RC37181: 2
2026-03-28 11:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with identifier: RC37181
2026-03-28 11:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with scrape type 2
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with scrape type 2
2026-03-28 11:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1, identifier: RC37181
2026-03-28 11:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with identifier: RC37181
2026-03-28 11:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with identifier: RC37181
2026-03-28 11:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1 with identifier: RC37181 to the API
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:53:07Z',
 'fuel_type': 'diesel',
 'id': '3fd0237a-7a4e-594a-a4d9-b0d9b5e07be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC37181',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 269940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.9 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC37181%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [auto1.es] INFO: Saving data for RC37181: {'auction_closing_time': 1774716787.0, 'created_time': 1774609396.812086, 'last_price_update_time': 1774695874.31971}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC37181') HTTP/1.1" 204 0
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: KV37790
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: AP29688
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [auto1.es] INFO: Scrape type for AP29688: 2
2026-03-28 11:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-28 11:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cc9dd3-c21b-5d22-8079-40f8431a0962 with scrape type 2
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cc9dd3-c21b-5d22-8079-40f8431a0962 with scrape type 2
2026-03-28 11:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4cc9dd3-c21b-5d22-8079-40f8431a0962, identifier: AP29688
2026-03-28 11:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-28 11:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688
2026-03-28 11:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d4cc9dd3-c21b-5d22-8079-40f8431a0962 with identifier: AP29688 to the API
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': 'd4cc9dd3-c21b-5d22-8079-40f8431a0962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP29688',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 158213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP29688%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [auto1.es] INFO: Saving data for AP29688: {'auction_closing_time': 1774716068.0, 'created_time': 1774361325.243337, 'last_price_update_time': 1774695874.733923}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP29688') HTTP/1.1" 204 0
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: RL18296
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL18296%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [auto1.es] INFO: Scrape type for RL18296: 0
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: TK95363
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: BE90053
2026-03-28 11:04:34 [auto1.es] INFO: Found listing with ID: VY28267
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [auto1.es] INFO: Scrape type for VY28267: 2
2026-03-28 11:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-03-28 11:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d268307-2399-5a10-bff1-00decfd055b5 with scrape type 2
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d268307-2399-5a10-bff1-00decfd055b5 with scrape type 2
2026-03-28 11:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d268307-2399-5a10-bff1-00decfd055b5, identifier: VY28267
2026-03-28 11:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-03-28 11:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-03-28 11:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267 to the API
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:14:45Z',
 'fuel_type': 'diesel',
 'id': '4d268307-2399-5a10-bff1-00decfd055b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY28267',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 151664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-22',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2018}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-03-28 11:04:35 [auto1.es] INFO: Saving data for VY28267: {'auction_closing_time': 1774714485.0, 'created_time': 1773126789.845021, 'last_price_update_time': 1774695875.160795}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY28267') HTTP/1.1" 204 0
2026-03-28 11:04:35 [auto1.es] INFO: Found listing with ID: HV58793
2026-03-28 11:04:35 [auto1.es] INFO: Found listing with ID: AU82484
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU82484%27 HTTP/1.1" 200 None
2026-03-28 11:04:35 [auto1.es] INFO: Scrape type for AU82484: 2
2026-03-28 11:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408e19ae-2b14-595b-962a-edf3caffd82f with identifier: AU82484
2026-03-28 11:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408e19ae-2b14-595b-962a-edf3caffd82f with scrape type 2
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408e19ae-2b14-595b-962a-edf3caffd82f with scrape type 2
2026-03-28 11:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 408e19ae-2b14-595b-962a-edf3caffd82f, identifier: AU82484
2026-03-28 11:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 408e19ae-2b14-595b-962a-edf3caffd82f with identifier: AU82484
2026-03-28 11:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 408e19ae-2b14-595b-962a-edf3caffd82f with identifier: AU82484
2026-03-28 11:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 408e19ae-2b14-595b-962a-edf3caffd82f with identifier: AU82484 to the API
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:01:34Z',
 'fuel_type': 'diesel',
 'id': '408e19ae-2b14-595b-962a-edf3caffd82f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU82484',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 252538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-20',
 'seller_name': None,
 'title': 'Peugeot 407 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AU82484%27 HTTP/1.1" 200 None
2026-03-28 11:04:35 [auto1.es] INFO: Saving data for AU82484: {'auction_closing_time': 1774713694.0, 'created_time': 1774350130.732837, 'last_price_update_time': 1774695875.62245}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AU82484') HTTP/1.1" 204 0
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:38 [auto1.es] INFO: Channel: 24h | Page: 65 | totalHits: 2555 | hits on page: 0
2026-03-28 11:04:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:04:38 [auto1.es] INFO: auto1.es Batch config: batch 1/2
2026-03-28 11:04:38 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201774263878 HTTP/1.1" 200 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ18059') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BZ27722') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CN35494') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CP55474') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ44348') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DA85741') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EK69979') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EU07450') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FE45976') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FY07234') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GD64298') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GK41284') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='GX93550') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HD15587') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HH60103') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HK76074') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HP31470') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JD03247') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JP85888') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JT13358') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KC95807') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KR07730') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MB84722') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MN98547') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NV64390') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='PH66754') HTTP/1.1" 204 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SF50504') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SN39920') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SP39350') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SR47675') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TR19943') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TZ40113') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UT30126') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VF55417') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VV96090') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WH88598') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WP96638') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XD32564') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XT23333') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XT40508') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XU96690') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='YU35408') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH97805') HTTP/1.1" 204 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZJ92513') HTTP/1.1" 204 0
2026-03-28 11:04:39 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (269 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_21_2026-03-28T11_00_00.jl
2026-03-28 11:04:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1076563,
 'downloader/request_count': 619,
 'downloader/request_method_count/GET': 552,
 'downloader/request_method_count/POST': 67,
 'downloader/response_bytes': 49704946,
 'downloader/response_count': 619,
 'downloader/response_status_count/200': 619,
 'dupefilter/filtered': 17,
 'elapsed_time_seconds': 273.705198,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 4, 39, 169474, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 269,
 'log_count/DEBUG': 8048,
 'log_count/INFO': 9341,
 'memusage/max': 178831360,
 'memusage/startup': 149893120,
 'photo_download_count': 438,
 'request_depth_max': 68,
 'response_received_count': 181,
 'scheduler/dequeued': 619,
 'scheduler/dequeued/memory': 619,
 'scheduler/enqueued': 619,
 'scheduler/enqueued/memory': 619,
 'scrape_type/batch_skipped': 1314,
 'scrape_type/new': 56,
 'scrape_type/price_update': 213,
 'scrape_type/skipped': 994,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 181,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.9834165435093993,
 'scrapy-zyte-api/mean_response_seconds': 3.026652953461409,
 'scrapy-zyte-api/processed': 181,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 181,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 180,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 181,
 'scrapy-zyte-api/request_args/httpRequestBody': 67,
 'scrapy-zyte-api/request_args/httpRequestMethod': 67,
 'scrapy-zyte-api/request_args/httpResponseBody': 181,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 181,
 'scrapy-zyte-api/request_args/sessionContext': 181,
 'scrapy-zyte-api/request_args/url': 181,
 'scrapy-zyte-api/status_codes/200': 181,
 'scrapy-zyte-api/success': 181,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 2594,
 'source/total_available': 2555,
 'start_time': datetime.datetime(2026, 3, 28, 11, 0, 5, 464276, tzinfo=datetime.timezone.utc)}
2026-03-28 11:04:39 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:04:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb72d6c13d0>
2026-03-28 11:04:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb72d494590>